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^ It has been the aim, since the inception of the Success-An 
Reading amiUWr4^1ns^rag^ffl . to incorporate or mesh the "best" 
most effective^ and most insightful methods and aspects of many 
approaches to reading instruction^ The program was brought to 
the attention of the District of Columbia Public Schools (DCPS) 
by the School Services Branch Of the Washington Post newspaper. 
Materials used in Success instruction are practically anything 
readable, within reasOh, such as newspapers, magazines, library 
books, textbooks of many subject areas, catalogues, product 
labels, etc. The programhas been implemented in certain DCPS 
elementary schools since February, 1979 on a voluntary basis and 
has grown tO include more schools each year since. 

Formal evaluations of the Success program have been conducted 
each year of its use in District of Columbia Public Schools, with 
the exception of the 1980-^81 school-year. The evaluations have 
been designed to provide teachers with information tO facilitate 
more effective program use (formative evaluation), to provide 
information to District of Columbia Public School administrators 
and Washington Poat^ decision-makers upon Which to base decisions 
concerning ^continuation of the Success program^ and to aid school 
persohhel ^primarily teachers and principals) in communicating to 
parents the viability of alternate (non-traditional) approaches to 
reading instruction. Additionally, evaluations of the ^nocesJ— in 
Reading and Waitin g P rogram in District of Columbia Public Schools 
provides decision-making information to other school systems^ 
nationwide, who are in search of instructional methods that may 
contribute to greater reading and language arts achievement. The 
present evaluation sjeks to address these audiences. 

The 1985^86 success in Reading ajid Writing j^lr^jsg^^ m 
encompassed 65 elementary schools, 191 classrooms, and" 
approximately 4,800 students, averaging 25 students per c^ass. 
The present evaluation focuses upon pre-kind ergarten through 
sixth grade Success classes. 

The objectives of the evaluation are as follows: 

1. To measure the effectiveness of the Success 
program in improving the reading achievement 
of students participating in that urogram. 

2. Tc measure the effectiveness of the Success 
program in improving the language achievement 
of students participating in that program. 
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3. to measure the effectiveness of the Success 
prbgrani in ifflprbving writ achieveiiient of 
students participating in that prdgram. 

4. fb measure the effectiveness of the. Success 
program in improving the reading. attitudes 
of students participating in that program. 

5. To determine the impact of the Success 
program on the promotion/retention rates 
of students participating in that program, 

6. To measure the effectiveness of the Success 
program in improving the reading achievement 
of those fourth grade students having partici- 
pated in that program at least two consecutive 
years from the second through third grade. 

7. To measure the effectiveness of the Success 
program in improving language achievement of 
those students having participated in that 
program at least two consecutive years from 
second through third grade. 

8. To determine student level of satisfaction with 
the Succe^ program. 

9i To determine teacher level of satisfaction with 
the Suc c ess program. 

Id. To determine principal level of satisfaction with 
the Suc^e^ program. 

the results reported in this evaluation are as follows: 

QSj ec tlve— ^-^ 

Statistical analysis indicates a highly statistically signifi- 
cant difference in total reading achievement means of Success 
and cdmparisbn third graders^ favoring the Suc(^^^ group. 
Highly significant difference was observed between the Success 
and. comparison third graders' means on the vocabulary sub- 
scale of the reading achievement measure. No significant 
difference was observed between the groups on the reading 
comprehension sub seal e . 

Objective 2^ 

Statistical analysis indicated no significant differences 
between the language achievement means of Success and com^ 
parison third graders. Analyses of the individual language 
achievement sub scale r esul ts _ ( i e . ^ mechanics , expression , 
spell inig) indicated no significant differences between 
Success and comparison group achievement. 

Vii 
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Objective-^ 



Statistical analysis indicated significant differences in 
the writing achievement of Success and comparison third 
graders, ^in favor 'of the comparison group. Gain analysis 
(pretest/posttest) of third grade Suc cess students' writing 
achievement indicated significant gain from January to April. 
Statistically significant differences were observed in the 
writing achievement of fourth grade veteran- Success 
students and a comparison group, in favor of the Success 
group. 

Ob^.lective 4; 



Statistically significant difference in the reading 
attitudes of Success and comparison third graders was 
observed, in favor of the Success group. 

Objective 5: 

The percentage of Success students promoted was greater 
than the percentage of the comparison group-promoted. 
A smaller percentage of Success students were retained 
when compared to the comparison sample. 

A smaller percentage of Suceess s'.;udents 
were Identified as having reading def iciencTes, when 
compared to the comparison sample . 



Ot^j^G4vj.ve 6 ; 

Statistical analysis indicated significant difference 
in total reading performance of veteran- Success and 
comparison fourth graders, in favor of the Success 
group. Individual analyses of vocabulary and compre- 
hensionsubscaie results indicated a significant 
difference in the comprehension achievement of veteran- 
Success and comparison fourth graders. No significant 
difference was observed between the groups on the 
vocabulary subscale. 

Objective 7^ 

Statistical analysis indicated a significant difference 
between the total language achievement of veteran- Success 

and comparison fourth graders. Individual analyseJ~of 

composite language subscaies ( i . e . , mechanics, spelling, 
expression) indicated significant differences between 
language achievement of the groups in each of the language 
skill areas, favoring the Suce ess group in each. 



viii 



Student questionnaire responses indicated a unanimous 
satisfaction with the Success program and most of its 
features. Positive suggestions were given by students. 

Ofaj^^ive 9: 

Teacher questionnaire responses indicated a Unanimous 



of the program were cited and several recommendations 
were given by teachers. 

Objective 19; 

Prihcipai questionnaire responses indicated satisfaction 
with- the program. Principals cited many advantages to 
Success program use and few disadvantages. A number of 
positive recommendations Were made by principals, con- 
cerning the S4J cc ess program. 




program. Many advantages 
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INTRdOUCtidN 



Th» S<icctt3v4B Rea ding a nd WHtIng R gogcaBt (Success) was introduced as a 
pilot project to the District of Columbia Public Schools under the umbrella of 
■the^Rlght-tOiReid effort at the beginning of the second semester of school 
year (SY) 1978-79. The progran was brought to the attehtidh of responsible 
public school officials through the School Services Branch of the Washington 
Post. A trip was then arraoged^f or key Bistrict of Columbia Public SChdol — 
officials to observe the program in action in the Ourhati eity (North earblina) 
Public Schools, *herethe^ prog ram was being used. Impressed with their 
dbservatiohs. they recommended that the program be tripj* in Washington O.C. 
as a pilot project in the district's Public schools. 



DESCRIPTION QFT 



^ late Dp. Anne H. Adams, a professor of educatibO-at Duke Urn* vers ity In 

Burbam^ North eapolina, conceived and developed the Success tn Reading an4^ 
Writing Proqrm . Dp. Adams began fdnfiulatihg ideas for the ppogpan duping hep 
tewre as a fipst gpade teachep in 1954. She had an intepest in attacking 
problems of ten assdci ated wi th^the_begi nning Instruction of reading. The key 
elements of theSucce^ Program are an outgrowth of her analysis of such 
problems. 

tatep as a doctopal student, pr^aring her dissertation. Or. Adams 

researched the concept of coPrelated lahguage_arts jn tne first gpade without 
the use of basal readers. The Success in Reading and Wp1t4^g Ppogpam evolved 
out of^ hep studies. She concluded that anything i n ppi nt (within reason, of 
course) sf*uld_be_part of the reading programs in schools. According td'her 
design. Instructional materials to be used in teaching students to read 
include the following: newspapers: fiction and non-fiction library books; an 
assortment_of content area textbooks; magazi nes , and s imi 1 ar materl al s . 
Qr._Adams__recpgnjzed a close li^nk in the acgui sition of reading skills and 
that of writing skills. Another recbghitldn was^that reading vocabulary 
evolves frail the experiences of the students themselves. The Success 
classrdcm^ typicallyi is fi 1 led wi th a number of charts ccmposed_df vocabulary 
words, \*rd cluster^,^hd sentences generated by the students. Display of z^e 
charts in the classroom encourages and facilitates easy reference zo tnetn at 
any timei 

the_ Succes s _ Program n ot only calls for changes in naterials of 

instruction, Dut provides for classroem procedural modi f ications as well. 
Whole-class instruct ion is preferred over tradi tidnal grouping practices! I: 
was Or. Adams* belief that certain grouping practices carnage the ef feet i ve '^es s 
of teachers as well as the self-concepts of :ne students. 
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Witftin tfte Saccess Program , individualized instruction, a key element of 
this approach, is defined as timejminutes or seconds) spent between teacher 
and individual student in focusing on what the student is d^di ng has done, or 
should be doing. This type of interaction is tailgred differently to suit 
each student's needs. According to Or, Adams' design, individualized contact 
should_occur three to four times during a lesson and is considered critical to 
the affective development of the students. 

The skeletal structure for each daily lesson is provided in the Success 
manuals prepared for each grade* To implement the lessons, teachers"ari 
encouraged and free to exerci se thei r knowledge^ expertise, and creativity, 
(Examples of a ^ne^day program for grades ki ndergarten through sixth grade may 
be found in Appendix A.) In general,^ Br. Adams sought to incorporate in the 
Success Program , the "best", most effective, and most practical ideas for 
reading instrjctidn fron past and contemporary approaches. 



_: With Success , the readi^ng instructional period is divided into four to 
five modules, each of approximately one-half hour in duration. Thus, the 
Su cce s s Progr a m is implemented 2 to 2-1/2 hours of the five hour teaching 
day. 



The modules taught by grades are: 



Alphabet 

Oral Language 

Picture Word Association 

Story Time 

Phoriics/Spel 11 ng 

Language Experience 

Academic, Cultural Art and Current 

Events 

Patterning 

Decoding in Context 

Compos i t ion , Fl uency/Accur acy 

Compos it ion 



- 2 - 




-Gr^d^ 



Kgn. 1 

X 
X 

X 
X 



X X 

X X 

X X 
X 



X 

X 



X 



The modules taught by grades are: 
(continued) 

Composition Writing 
Research Practicum 
Study Skills 
Recreational Readi ng. 

Instruct ional Envi rdnrnerit : 

The envi rorment in each participating classroom should reflect key 
elements of the progran. Some of the key elements expected in any field 
observation of the Success Program in action would be the fblldwihg: 

(1) Adherence to posted schedule; 

(2) whole class teaching during preliminary discussion period 
(apiproxi 10 mi hutes) ; 

(3) contact with each child during the writing phase of modules 
(individualized instruction); 

(4) continuous display of charts- 

(5) display of charts with students' vocabularies (words, word 
clusters, sentences, paragraphs); 

(6) use of a wide va ri ety of printed materials (newspaper^ 
magazines, library books, textbooks, charts, product labels, 
etc.); 

(7) development of independently wri tten ma teri al s (factual 
and creative); 

« 

(8) fostering independence (proofreading and scoring); 

(9) pranqting account abi li ty (daily filing of papers by students 
themselves) . 

* See observational checklist ased in determining imple'Tientation levels of 
Success classes. Appendix j. 

- 3 - 



Kgn. 1 



Grade 



X x 

X X 
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General Obj^ct^ygs of Success Program 



The three main oMectives of the Success Program are to develop in the 
learner reading and writing skil Is in the _cogn 1 tiye domain and the develop- 
ment of a positive self-concept in the affective domain. The Saccess- manuals 
for each grade delineate specific achievement expected in the aforementioned 
areas, by grade level. 

By the end of the school year each Success student should have experienced 
the fol lowi ng : 



Reading 6ppbrtuni ties 

o 399/350 library books 

0 daily newspapers 

0 current magazines 

0 textbooks (science, social 
studi es, mat heiia tics and 
music) primary level/ upper- 
grade 

0 pamphlets, catalogues, etc. 



— Grades— 



1 


2 


3 


4 


5 6 


300 


300 


350 


350 


350 350 


X 


X 


X 


X 


X X 


X 


X 


X 


X 


X X 


X 


X 


X 


X 


X X 


(primary) 




(primary and upper grade) 


only 










X 


X 


X 


X 


X X 



Writing Opportunities 

d daily creative writing x x x x x 

o daily factual writing related 

to academic content information x x x x x 

0 a variety of writing skills 

emphases x x x x 

0 words ,_phrases, paragraphs, and 
stories containing vocabulary 

from students in the class x x x x x 



0 immediate closure and long-term 

writings x x i x 

0 daily proofreading checks x x x x 



- 4 - 
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Affective Opportunities 

0 Sdccess In Academic Pupsaits 

0 Positive and protect jve atti- 
tude toward school^ teacher, 
clossnates 

0 A positive self-concept relating 
to past^ present, and future 
learning experiences 



Grades ^ 

T 2 § 5 5 6 

X X X X X X 

X X X X X X 

X X X X X ' X 



History of the Success: Program-if>-the^ 
B1stpjj^ -Qf eolamfala Publ ic SchooT?^ 



1978-79 Pilot Project 

The Su c cess in R eading and Writing Program was piloted in the second 

semester {Jan. 2? -June 14t_19 79) in 6 schodls of Region V in the District of 
Cplufitoi a Public Schools, There were 18 classes with an approximate enrollment 
of 450 students. The eighteen classes were located in 6 different schools. 
Each school had a firsts second and third grade class. 

The evaluation of the Success-4^^-ading and Writing Pilot Project during 
school year 1978-79 disclosed interesting aspects of its implementation and 
provided substantial baseline data for more comprehensive pvaluation. The 
1978-79 evaluation made many recommendations to improve the program, one of 
which was to provide training and technical assistance to the teachers using 
it. 



1979-^X98d-P4lot Projects 

The Success Program was expanded during the SY 19 79-80 to encompass six 
regions of the O.C. Public Schools. There were 66 teachers in 21 schools 
teaching ki ndergart eh through fourth grade as of Septsnber 1979. Principals 
and teachers from participating schools received training from Or. Adams- 

The evaluation of the S^rces^ Progr am for SY 1979-80 disclosed the 
f 0 1 1 owi ng : 

(1) The reading achievement gains of _ the Success group (on the 

Comprehensi v8_Test of Basic^ Ski 1 1 s ) were significantly higher 
than those of the comparison group ; 
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(2) The teachers were satisfied with the program for a variety 
of reasons ; 

(3) Althodgh the comparison group wrote better than the Stic^eis 
gpoap in the wri ting exerci se» the results were to be reviewed 
cautiously. The evaluator was not in charge of administering 
or collecting the sanples frcm the two groups. It appeared as 
If the conparison sample did irore "select ing out" of low 
quality papers than the Success sample. 

(4) There was a significant di fference between the pre-test and 
post-test means of third grade Success students dh the -Estes 
Att4^tu4e Scale which was administered to measure reading 
attUudes. These results indicated that the Success group had 
developed a more positive attitude toward reading over the 
school year. 

1980-81 Success Prbqram 

_ There were 32 elementary schools and 83 classrooms in the Success program. 
The Success grogj-am was expanded to 30 classroons in 15 junior high schools 
systemwide in February 1981. No fomal evaluation was prepared for the 
1980-81 school year. 

4381^82^ccess Program 

The 1981-^ project included 88 classroans in 39 elementary schools 
grades^K-4. There were 41 classes at 23 junior high schools. Four special 
education teachers also participated. The project director having worked with 
the^program intermittently since its inception, came on board on a full-time 
basis as^of February 1982. The principals and teachers fr cm participating 
schools (elementary and junior high) received training frcm Helen Cappleman 
(Or. Adams' successor). 

The evaluation of the Sa cee s s Program for SY 1981-82 disclosed the 
following results; 

(1) First and second grade Success and comparison groups did not 
differ significantly in their reading performances as measured 
by the California Achievement Test (CAT). The third grade 
Success groups had a sign i fieantl vgrparpr reading achievement 
gain than the conparison group on the CAT . 

(2) Teachers appeared satisfied with many aspects of the Success 
Pr ogrjua but there were some problems. ' 

(3) Principals of the sample indicated satisfaction with the 
Succes-s Program . 
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(4) Tfte Succasl groups (canpbsed of third and fourth grade 
classes} had significantly more positive attitudes toward 
reading _than the canparison grouis as measured by the Estes 
Att1tQde-Sca4e> 



1982-83^ Succmss-Pr pgr am^ 

the Success Program was used in 45 elementary and 23 junior high schools. 
At the elementary live 1 , 74 teachers taught the Success Program on a full-time 
basis; 22 teachers used the Success Program pa rt ial ly. Seven sped al 
education teachers participated in the program. 

For the first time, the Suci^ess Program had a_d[rector for the entire 
school year. Many staff devel opment act ivi ties were arranged by the director 
for the SY 1982- 83 • These activities included training sessions and 
demonstration lessons on all grade levels involved. 

Results of the 1982-83 Success evaluation are as follows: 

(1) The mean acfiiwement scores of third grade Success students 
on the CTBS were significantly higher than those of the 
canparison groups 

(2) Statistically significant differences in pre-test and post- 
test means on the Estes _Readi ng Attitudes Scale were 
observed for. third and fourth rrade Success students. 

(3) Statistical ly sigh if icaht difference in means between third 
and. fourth grade Success and comparison groups oh the writing 
exercise were oosen/ed. 

(4) Elementary teachers (grades 1-6) appeared satisfied with the 
Success ProgratfTj. Junior High teachers reported satisfaction 
and a number of concerns about use at that level. 

(5) Principals of Sacjte-SJ classes reported satisfact ion wi th the 
program • 

(6) The Succ^^i Program had a positive impact on student 
protiot ions . 



1983-84 Success Program 

The 1983-84 5uccbS-S Prograrn was in operation in 54 elementary schools (with 
134 teachers from pre-ki ndergarten through sixth grade) -Doe to the lack of 
program part ici pat ign^ an eval uation of the junior_high school level was^ot 
conducted. An attempt was made to evaluate the -Succe ss Program implemented in th( 
Adult Education prograrn. However, due to attrition c.nd low and irregular 
attendance of. the adul t_ students, a meani ngf ul _eval uatlon at_this level also 
was not possible. Results. of tne evaluation of the Success Program at zr.e 
elementary level for SY 1933-84 were as follows: 
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i^^-^iSBH Success Program (cbn't) 

(1) There was no stat isticaiiy significant differehf ^ in niean 
CTBS reading achievement scores at the third grale level 
between Saccesa and comparison groups. 

^2) The Saccess J ^ rbgr am had a positive impact on student 
promotions . 

(3) There was a statistically significant difference between 
second grade Su£2^S£ and comparison students' performances 
on a creative writing exercise. 

(4) Students of grades 3-6 reoorted satisfaction with the Success 
gj-ggr^m in questionnaire responses. 

(5) Pre-kindergarten and l<indergarteh teachers reported 
satisfaction with the Success Progj'vaffi in questionnaire 
responses. 

(6) Teachers of grades 1-6 reported satisfaction with the Succ ess 
^rogf am in questionnaire responses. 

(7) Principals who responded reported satisfaction with the 
Success Program in questionnaire responses. 

1984-85 Success Program 

The 1984-85 S uccess Pr^r^ operated in 59 elementary 
schools, 177 classes. For the first time, an attempt was made to 
determine the effects of continued Success participation and the 
effects of the interaction between achievement level and 
method of instruction. Results jf the evaluation of the 
Program for SY 1984-85 are as follows: 

(1) There was no statistically significant difference in the 
performances of Success and comparison third graders in 
the sample on the CTBS reading achievement measure. 

(2) No statistically significant difference was found between 
Success and comparison third graders' performances on the 
CTBS language achievement measures. 



(3) No statistically significant differences between Success 
and comparison third graders were found in an analysis of 
the interactional effect of achievement level and method 
of reading instruction. 

(4) Statistical analysis revealed no significant differences 

writing performance ratings across third grade 
Success and comparison groups. 

^5) Success Program teachers report satisfaction with that 
method of instruction as evidenced from questionnaire 
responses . 
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(5) Third and fourth grade students responding to a 

questionnaire reported sat isf act ion with the Success 
Progr am and favor its usei 

(7) Principals responding to a quest ionriaire reported 
overall satisfaction with the Success Program and a 
desire for its continued use at their schools. 

(8) Proportionately ,_ the promotion rate for the Success 
third grade sample was not greater than the system- 
wide promotion rate • 

(9) A_ highly statistically significant d if f erence_ was ^ 
observed between the reading attitudes of Success and 
comparison third graders, favoring the Success group. 

(10) No statistically significant differences wer? found between 
Success - continuing and comparison group fourth graders' 
performance oh reading and language measures. A highly 
satistically significaht difference was observed in the 
writing performances of the two groups, favoring the 
Success groupi 

1985-86 -Success Program 



_ The 1985-86 Suc4;es3-4fl -Heading- and Writ i^g^rogram was_ ^ _ 
implemented, to varying degrees , in 65 elementary schools, 1 9 1 
classes. The program, within the Instructional Services Center 
( i .S.e . ) , is staffed by a full-time director and a part-time 
evaluation consultant , J^/ . Clerical support for the program is 
provided by the I.S.C. the Division of Quality Assurance pro- 
vides technical assistance and facilities to the evaluation 
consultant for data processing. 

EVALUATION DESIGN 

Certain design considerations aimed at gaining greater 
control of relevant variables for more accurate measurement 
influenced modifications of the 1984-85 evaluation design. 2/ . 
Sampling procedure was altered at that_time to include only schools 
having absolutely ho history of Success use in the comparison sample 
to possibly gain more control of confounding variables related to 
communications and/or collaboration among teachers within a school. 
Additionally, ah attempt to part ition the variance between achieve- 
ment levels of students was also built intothedesignof the 1984-85 
evaluation^ The student, teacher, and principal questionnaires 



V/ A list of the activities conducted by the director of the 
program, relative to its operation for SY 1985-86 may be 
found in Appendix C. 

2/ See 1984-85 Sucee^SnS Final Evaluation Report for more 
detailed description. 
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Figure i 



SUCCESS IN READING & WRITING PROGRAM 

PARTIGIPATIQN BY GRADE LEVEL 
(Percentages of classes) 



Grada 2 




Pm-K 7.6% 



6rad« 8 5.93 



Crad« 5 7X 



Grade 3 



Crad« 4 10.3% 




*Nbte: Percentages based on 185 classes, not inc'.uciinc; school-based 
readincT specialists. 
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were also oodified to yield more data with the ihciasion of 
open-ended Iteoa. 

i.h« idSii^fl? presenj^evaluation effort, it was determined that 
the 198i»-85 evaluation design- was basically a sound one 
methodologically and practically. However, a decision was 
mace to include in the edmparisch sample of the 1985-86 
evaluat-'on several classes from schools participatina in the 
|a£|±«^rogram, but not participaUng a? third'|raSe live?! 
A3 the Suocass Program spreads, the pool o>' pure noh-S^ess 
comparison schools shrinks. The schools referred to here we re 

teachers new to the So^^eas PrLrtmt ?| was 
Cl^ni l^^^ the probability of ''conta mination" o? the comparison 

iras3es"f?oS%hfr^^^-^"°"^?.'°^"^"^^ elimination IV 
Classes from that group. The basis for this assumotion aUo 

warferv'littli'?r'"^'^'^^ teachers who reiatinhat^there 
dif-fli^,^tim l^^^^ communication between teachers of 
Thif wff Hn^ n.4l^^^?^ especially, concerning teaching methods. 
This was due, primarily, to time constraints. 

^ Another modification to the previous design involves 
inclusion of additional analyses to examine thl indi?idull 

i.^^^io"^" reading and language measures acrbss 

^xoresHon ^^nffnJfi =on,prehension, mechanics, 

w^fff^! f ^4^^^^!^^^"^^• ^ Pretest-postest analysis of 
"r^^l^ "^^^ in the present evaluation, 

wt.her analyses were of two-groups, postest-only structure. 
(Consult Appendix B for a complete chart of the evaluation 
u eaign . } 

db jee tlv es 

The objectives for the 1985^86 Success in Reading and Writins 
Program Evaluation are as follows: writing 

1. To measure the effectiveness of the Sacces^ proeram in 
improving the reading performance of'students partici- 
pating in that program. 



2. To measure the effectiveness of the Suo^^^ program in 
improving language performance of students participatine 
in that program. ^ e> 

3. To measure the effectiveness 6f the Sy^scess program in 
improving writing performance of students participating 
in that program* ^ * 

4. To measure the effectiveness of the Success program in 
improving the reading attitudes of students participatins 
in that program. xHat-xne 



-1 1- 



ERIC 



P3 



Ob.le&tivea Ccbh'ti) 

5. To determine the impact of the Succeis program 
upon the promotion/retehtlbh rates of students 
participating in that prbgranii 

6. to measure the effectiveness of the Success program 
in improving the reading achievement of those fourth 
grade students having participated in that program 
at least two prior consecutive years* 

7. To measure the effectiveness of the Success program 
in improving the language achievement of those fourth 
grade students having participated in that program at 
least two prior consecutive years. 

8. To determine student satisfaction with the Success 
program. 

9. To determine teacher satisfaction with the Success 
program. 

10. To determine principal satisfaction with the Success 
program. 

Met ho d olog^ y 

Sampllq^ plfocedure - The follbwing procedures Were used to 
generate the sample for this study: 

^ The list of_all Sttcceaa program participants for SY 1985-86 
was consulted. From direct observations of the program director 
and information gathered from Success program records, length of 
program participation was estabTIIhld for each teacher. Only 
teachers having at least two years of experience in the. Success 

program were considered for inclusion in the present sampT?: 

This criteria was established by the program director and the 

'^^^^^ experience with the program, its 

^""^ consideration of a reasonable amount 
of time required by teachers to achieve a high degree of facility 
in its use. The third grade level was identified as having the 
most teachers^ffleeting this criteria and evidencing the greatest 

Current testing policies c 
the District of Columbia Public Schools made available criterion 
TrPhr"'."^ data^ for thirds fourth, and sixth graders systemwide 
in Che .orm of standardized achievement test scores. The 
Compr^eRslve Test of Bas^c^killg (CTBS) was administered in 
bpring, i9oo. 

^^Su££e2^ program participation at the fifth and sixth iride 
levels IS sparse at the present time. It Was assumed, based upon 
widely^ accepted developmental theory, that children of the third 
grade level and above would generally be able to provide more 
substantial and more interpretable writing samples than younger 
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students, therefore^ it was determined that the probability of 
obtaining the most representative sample of Success classes wotaid 

^fifr;^!^^ ^^..^^^ ^^^''^ eride ievil, with the availability o? 
validated reading and language measurement data. 

f«„ii'^5i''''^''^^f ^^^^^'^^^'^^^^^P^^'^ '^''^ schools having at least two 
H^lLl^Vf °ip-- f^^ ^'og''a^experience were listed to be observed 
directly to determine their level of implementation. Classes 
were observed in a random order by the program -valuator. All obser- 
vations were unannounced, at which time each Success classroom 
scenario was compared against an implementation checklist of key 
elements of the program. (An example of the checklist may be found 
in Apendix J) . Additionally ^ a standardized interviewing 
technique was employed to assist in this determination. This 
technique, t*^els_e£_Use (L.O.U.) is a component of an 
interviewing system, the Concerns-Based Adoption Model (CBAM). 
inl f^!P=f^l^ change to be a highly personal and lengthy process, 
one that affects individuals differently." 3/ L.O.U is a 

^«°'f^^^°r°^ ^""^^^ ""^^^^ describes the behavior of individuals 

fnnnSff^S"^"'? familiar with and more skilled in using an 

^" present study, the Success in Readin g ^nri 

^^^^^R -Pr^firam was considered the innovation; The L.O.U. 

procedure involved interviewing Suae^ss teachers using 

ri!!;??!'?-?^'^.''"!?^^^"!* This technique, however, provides some 
flexibility in the order in which the questions may be asked, 
encouraging more complete and detailed responses. Teachers were 
interviewed at the time of observation by the program evaiuator. 4/ 
til .^"J^J-views were tape-recorded in accordance with the design of 
the L.O.U. technique. Data gathered in the interviews was used to 
determine the Level ^oi^OJae (deerep of implementation of the 

,0"ly teachers identified as operating 
at the "routineVlevel Of use (Level IV-A) were included in the 
sample, in that, they would most likely be those teachers imple- 
menting the SuQcess-J' r^^r am . such that the integrity of its 
fundamental design was maintained. All observations and inter- 
views were conducted during the months of October, November, and 
into December.. Upon completion of observations and interviews. 
±ist of high-implementing Success classes was derived. All 
school regions of the city were represented in the sample. 5/ 

2/ S.J^ Loucks, B.W Newlove, and S.5. Hall Measuring Levels oF Usp 

o£-tj^^Movation; A Hanuai foi^Paine^^ Interviewer s, and 

pl^. (Austin^ Tx.: K & D Center for Teacher Education. The' 
University of Texas at Austin, 1975). 

^/^ Success Program evaiuator was trained and certified in the L.O.U 
technique by the DGPS Division of Staff Development in September, 

5/ Figure 2 displays schools included in the sample, by region. 
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Selection of a comparison group proceeded from the 
cbmpilatibh of a list of those Chapter I schools either having a 
history of absolutely hb Suiixcess Program participation or_who3e 
SuxicBSS participation was not on third grade level and teachers not 
experienced in the program (new to the program) . Effort was made 
to control for socioeconomic status factors by selecting a 
comparison sample of relatively the same SES composit ion as the 
Su£c_e5£ sample. This was accomplished through the use of a 
document produced by the Division of Quality Assurance, D.C.P.S. 
entitled Select ^ ion of l^t b 1 e C j;^^fee-i^ -I— A tt e^^^c e A r e a.s f o r the 
Di3trlct ^4^Col4Wte^ a SY 4^§-'^^^ The table libeled RankinR of _ 
Eleffl^^trary-^ttreiidance Arreas Eligible for the Expenditure of ECIA _ 
Chapter I Funds for SY 1986_Ba3ed (Jpdh the Number and Percent of 
Economically Disadvantaged Students Enrolled in Accord with the 
U.S. Department of Education Guidelines was the specific reference 
consulted in this procedure _ All of the above sampling procedures 
were also followed in the selection of a sample of fourth grade 
veteran -> Succes3 students for ah analysis- of a longitudihal nature^ 

: In addition, the principals of several known (based on previous 
studies) high- implemeh ting schools , having Suc-ceaez participation 
oh the first through fourth grade_ievels were asked to identify 
thbae Success fourth graders in their respective schools who had 
beeh_taught in the Success- EraRr^am consecutively in second and 



facilitated sample selection pertaining to objective #6 • 

Letters were sent by the S u c c e s s^ P r or r^am Director to all 

schools considered for sample inclusion. The letter generally 
introduced the evaluation intentions and asked for the cooperation 
of principals and teachers. Subsequent to the above sampling 
procedures, a telephone call was placed to each of_the selected 
comparison schools by the pro gram eyaluatorto confirm willingness 
to participate in_the evaluatiph. The final sample selection was 
then completed. Figure 2 displays schools included in the sample, 
by treatment group and by region. 



third grade, as well ( 




This information 
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Figure 2 



SCHOOLS OF SUeeESS El'AtUATION S.^WhE [1985 - 863 



REGION 


SUCCESS 


CGNfPA-RTSON 


A 


Garrison 
M. L. King 
Bimey 
Leckie 


Nfontgomery 

Savoy 

McGogney 

Turner 

Patterson 


B 


Powell 
Takoma 
LaSalle 




C 


H. D. Cook 
Gage-Eckington 
Bunker Hill 
Mever 


Park View 
M: Reed 
Lewis 
Tubman 


D 


Ludlow- Taylor 
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steps in Sequence 



_ In January^ letters went out from the Stjccess Director to all 
teachers of _ the sample asking. them . to administer a writing exercise 
to their third (and/or fourth) grade classes, using as a topic: "if 
I could change places with anyone in the world, I would be ••ii.i" 
tell why* Teachers were ask to administer the writing exercise by 
a given date for uniformity. Addit ionally , they were asked to 
conduct a short pre-discussion period just prior to the actual 
writing period, which was to be no longer than 30 minutes in 
durationi_ Teachers were instructed to include all papers, 
regardless of quantity and/or quality of the writing. 
Return-addressed envelopes were provided each teacher for 
returningessays. Returned essays were coded by prior to 

being rated, having no ter.cher or school identification visible 
onthem.Thisprecautionwastakento controlfor possible rater 
bias. The essays were then randomly given to two raters by the 
evaluator. The Succ^^g^ program director and a volunteer 
assistant, both reading specialists, served as raters of thewriting 
exercise compositions. the papers were ratedon a scale of 1-4 
with 4 representing the rating of highest quality. Criteria for 
rating included clarity of expression and cogency. Each rater, 
read each paper, reaching a_ consensus on discrepant ratings. This 
method of scoring is the holistic method , described as one in which 
a_"whole" or overall impression of the composition is attained. 
(For more detail on the holistic rating method see Appendix E.) 
All data were analyzed, by hand, by the program evaluator using 
inferential statistics (t-tests for independent samples and 
t-test for correlated samples in the gain analysis). 

In April, an identical procedure was followed in_ the 
gathering of "posttest" direct _wr it ing data. it was anticipated 
that compos it ion s_cf greatly reduced quality and quant ity might 
likely be received if the January writing topic was retained^ due 
to lack of mot i vat ion associated with the recall of that topic . 
The topic used in the posttest writing exercise was "The most 
memorable day of my life was when ..." (Tell why. Describe what 
happened . ) 
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A certain degree of error is inherent in a change of topic, 
due primarily to the jjbasibility of differential levels of 
motivationai variables associated with_the__topic3._ It is also 
widely recognized in the profession that topics that call fcr 
responses in different rhetorical modes often require somewhac 
different skills (Sharney, 1984; Hoetker* 1982; Lloyd-Jones , 1977 ; 
White, 1985). 6/ Consistency of the design of essay topics is 
essential for ""fair" comparison among experimental groups. The 
topics.USed in the present evaluation were of the "exposition" 
type* It should be noted that most of the research in this area 
has been done at the high school and college level. It was _ 
assumed that the same concerns and processes apply to writers at 
all levels. 

In Hay, all classroom teachers of the sample were mailed 
Estes Reading Att itude^Seal^s to be administered and 
rAtnrned to the SUccess evaluator. All completed instruments were 
scored by the program evaluator and program director; The program 
evaluator analyzed the data utilizing a t-test for independent 
samples i 

in May, questionnaires Were mailed to all Successful Reading 
and Writings Program participants. Each Sue^sesa teacher, 
principal7?nd student were sent the appropriate questionnaire to 
be completed and returned to the Success director no later than 
June l3thi l986;Preaddre3sed return envelopes were provided to 

teachers and principals for all materials. In July, all 

questionnaire data was compiled and analyzed by the program 
evaluator. Descriptive statistics were computed for all question- 
naire responses and comprehensive lists of all recommendations^ 
were generated, by group (i.e.-, students, teachers, principals). 

6/ See Gharney, D. (1984). The validity of using holistic scoring 
~ to evaluate writing: A critical overview. Research m the Teaoj^ng 
oZ English . 18, 69-71 and Hoetker, J. (198p^ Essay examination 
topics and studentsl writing. Coll ege e ompo^ it ion and 
goiirttttnlcat ion . 33, 377-392. 
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Baring June, 1986, . reading and language achievement test 

data for third, and .fourth grade .students of the evaluation 
sample was gathered, from . the Of f ice., of .Student Assessment of 
the Diyision of Quality Assurance (DCPS) i The instrument 
used during SY 1985-86 was the Cbmprehehsi ve test o f Ba si^ 
SkilOs (CTBS), 1973 edition^ Level 1^ Form- Tf which was 
administered . once in May, The GTBS ±s a norm-referenced 
achievement instrument produced by the McGraw-Hill Publishing 
Company. Test item development for this instrument was a 
collabdratidn _or teachers, curriculum specialists, and the 
publisher CTBS/McGraw-Hill . The publisher reports having 
attempted to identify and eliminate ethnic bias as a part of 
hdrming procedures. The raw data in the form of total 
reading and writing scores and subscale scores (reading arid 
language skill areas) were entered into a mainframe by the 
evaluator and analyzed using the Statistical Package for 
Social Science (SPSS) program, for use as criterion data in 
the posttest-only design of the planned analyses. 

Promotion/retention data for all Success students in the 
evaluation sample was obtained from the Division of Quality 
Assurance. This data included promotion and retention rates 
of the individual Success classes of the sample, as well as 
that information for the entire schoolwide third and fourth 
grade population. Further, information was provided to 
identify those students who Were retained due to reading 
deficiencies. All data was analyzed by the program 
evaluator, using descriptive statistics. 
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Objective t 

To measure the effectiveness of the Su<:cess Program in 
improving the reading achievement of students in that program. 

A t-test to determine the significance of variance between 
Sy^c<D<s^s and comparison group means was performed using available 
reading achievement data , The criterion level of statistical 
significance Was set at 0.05. Datawas collected for 15 third 
grade_ Success classes from 1 3. schools and 12 comparison classes 
from 9 schools. Table 1 displays the result of this analysis. 

Table 1 

Reading Achievement of Third Grade Succe^ and Comparison Students 
Based on Total Reading Scores. 



Group 


No of 
Gases 


Means 


S.D 


-T— vaiue- 


Level of 
Significance 


Success 


320 


58.04 


15.96 


2.44 


iff 

Significant 
beyond 
.01 
level 


Comparison 


261 


54.73 


16.69 



Summary : 



The_ t-value of _2.4i| indicates a highly statistically signifi- 
cant _ difference in Success and comparison group performance oh CTSS 
total reading scale, in favor of the Success group. The Succesi^ 
group performed significantly better oh this measure than did the 
comparison group, demonstrat ihg greater readihg achievement. 

The reading achievement scale of the £TBS is composed of 
vocabulary and comprehehsioh subscaies . A separate t-test was 
performed oh data for each of the subscaies , compar ing the treatment 
ahd comparison groupsi These analyses were performed to determine if 
one of the skill areas (vocabulary or comprehension) was more re- 
spohsibie for the variance between groups. 
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Tables 2 and 3 below display the results of these analyses. 

Table 2 





No. of 






Groups 


C 3 


Means 


^ . D . 




320 


28.45 


i.nn 


Comparison 


263 


26.03 


7.74 



3.83 



_Level of 
Significant 



Signif ican 
beyond the 
.001 
level 



Summary: 



cant jjy^l^^riftli^U^^^lll-^i?^*^?'' 3lsniri- 

vocabulary subscalf ^ 

The^Syc^«ss group evidenced'great^r vocabulary 



achievement than did the comparison group. 

Table 3 




No. of 

-Cases 



Comparison 



320 



261 



Mean: 
29.59 



9.80 



28.64 




T-Vc lu -e 
1.16 



Level of 
-Signific ance 

Not 
Significant 



Summary : 



cani- H?rro" °^ U^^ indicates that no statistically signifi- 

eroLf u'''^-'^'^ ^"^^^ performances of the two 

groups on the comprehension achievement subscale. The Success 
and comparison groups performed at the same level on th e melfu re 

Srm^J°'"^'^?!^'^^^'"^"°^ ^" Success and comparison group per- 
formance on the vocabulary subscalF-is responsible for the 

betieen^gr^oups!^' ^"^'^^^^ total^eadin'g achie'Jiment 
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To measure the effectiveness of the Succesi Program in 

improving the language achievement of students participating 
in that program. 

A t-test to determine the significance of variance between 
S uccess and comparison group means was performed using available 
language achievement data. The criterion level of statistical, 
significance was set at 0.05. Data was collectea for 15 third 
grade Success classes from 13 schools and 12 comparison classes 
from 9 schools.; Table 4 below displays the result of this 
analysis . 

Table 4 

Language Achievement of Third Grade Success and Comparison 
Students Based on Total Language Scores^ 



Groups 


No. of 

Case^ 




S.D. 


T-value 


Level of 
Significance 




314 


70.17 


14 .44 


-0.05 


Not 

Significant 


Comparison 


259 


70.23 


14.23 





Summary : 



The t-value_of -0.05 indicates that there is no statistically 
significant di fference between third grade Success and comparison 
group performance on the total language achievement scale. Both 
groups demonstrated the same level of achievement on this measure. 

The language achievement scale of the CTBS is composed of 
three subscalesi A subseale to measure skill in expression, a 
subseale to measure skill in language mechanics, and another to 
measure spelling skills are represented in the total language 
achievement scores 

An analysis of each of these-^skiH 
indiyidualiy to determine if Success and comparison groups 
differed significantly in one or another of these areas . 
Tables 5-7 below report the results of these additional analyses. 
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Table 5 

Language Achievement of Third Grade Sucg-e^s and Comparison Students 
Based oh Mechanics Scores 



Groups 


No. of 

^ase s 




S.D. 


T-valup 


Level of 
S±p;hif ica^i- 


Success 


315 


14.33 


4.23 


-1.12 


Not 

Significant 


Comparison 


244 


14.75 


4.53 



Summary : 



The t-value of -1 .12 indicates that there is no statistically 
significant difference between the sample group means on the 
mechanics subscale of the 1 ahguage achievement measure. The 
Success and comparison groups demonstrated the same level of 
achievement on this subscale. Table 6 below presents the results 
of the language/expression analysis. 

- Table 6 

Language ftehievement of Third Grade Su^^^s and Comparison 
Students Based on Expression Scores 



Groups 


No. of 

-Cases \ 


Means^ 


S.D. 


Level of 
T-value Sisnificanc 


Success 


316 


21 .45 


5.55 


Not 

-GL. 83 - -Significant 


Comparison — 


260 


21 .33 


5.14 
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Summary: 

_ The fe-value of -O.83 indicates that there is ho statistically 
significant difference in performance of Success and comparison 
third graders on the expression subscale of the language achievement 
measure^ The two groups demonstrated the same level of 
achievement on this subscale. Table 7 below reports the result 
of the spelling analysis. 

Table 7 

Language Achievement of Third Grade aocc^esa and Comparison 
Students Based on Spelling Scores 



Gr^#a 


No. of 

Cases 


Means 


S 


. D. 


T-Value 


Level of 
Significance 


Success 


319 


34 


.19 


7 


.12 




Not 














0.83 


Significant 


Comparison 


260 


U 


.70 


6. 


81 



Summary : 



The t^vaiue of 0.83 indicates that there is ho statistically 
significant difference in the performance of Success and com- 
parison third graders on the spelling subscale of the language 
achievement measure. The treatment groups demonstrated the same 
level of achievement on this subscale. 



Objective 3 ; 



To measure the efrectiyeness of the Success Program in 

improving the writing achievement of students participating 
in that program. 

in January and in Aprils classroom teachers of the sample 

conducted writing exercises on topics, specified by the program 
director and evaluator. Ratings of these compositions provided 
datafor the writ ing achievement analyses^ Due to insufficient 
comparison group pdsttest data for the third and fourth grade 
sample, a comparison of gain between the two groups could not be 
performed. A gain analysis was. performed for the Sudces^ group, 
for which there was more cbniplete data^ A t-test for non- 
independent (correlated) groups was the statist icai procedure 
used for this particsular analysis. A t-test for independent 
groups was Used to analyze the January writing performances 
of the Success and comparison groups. Similar analyses were 
conducted on third and fourth grade data. Tables 8-10 report 
the results of these analyses. 

Table 8 

Writing Achievement of Third Grade Su^^^ and Comparison Students 
(January Writing Exercise) 



Groups 


Mo. of 

-Ca^e^^ 


- Means 


S.D. 


T-value 


Level of 
Significance 


w»^W ^> 


243 


1 .80 


0.85 


4.55 


Significant 
beyond .001 
1 evel 


Comparison 


95 


2.21 


0.82 



Summary : 



The t-value of 4.55 indicates a highly statistically signifi- 
cant difference between Suocess and comparison group writing 
achievement oh the third grade level, after five months of 
instruction. This result is in favor of the comparison group. 

*Note: The foregoing results should be interpreted with caution 
due to the probability of the "selec ting-out" of certain 
compositions , particularly in the comparison group. The 
number? of compositions received from some cor-iparison classes 
indicates the likelihood of this occurence. 
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Objective 3: Ccon*t) 



Table 9 below reports the result of the writing gains 
analysis conducted on Success group data collected in January 
and April. 

Table 9 

Writing Achievement Gain of Success Third Grade Students Based on 
Pretest-Posttest Writing Exercises (January and April) 



Time of 
-Te^t ins 


No. of 

Cases 


Means 


S.D. 


T-.v*l4je 


Level of 
Siji^nif icance 


January 


88 


2.00 


0.98 


4.91 


Significant 
beyond the .0' 
level 


April 


88 




- d-. 94 - 



Summary : 



The t-vaiue_of 4 .91 indicates a highly statistically 

significant difference between the writing achievement of 
Success third graders in writing exercises conducted in January 
and in April (i..e. , mid-year and end of school year). The S access 
third graders wrote significantly better in April than they did in 
January . 

Note: A portion of the variance observed is possibly due to 
differing mot ivat iorial or stimulus effects of the two 
different topics used in the writing exercises. This 
represents a certain degree of error variance. 

Table 10 reports the results of the analysis of fourth 
grade veteran- Success arid comparison group writing achievement , 
measured in January. The selected Suex^ass fourth graders were 
students.whb had been taught reading through the use of the 
Success Program on the second and third grade levels (veteran- 
Success students). 



Objec^jye 3 ; (con't) 



Table 10 



Writing Achievement of Fourth Grade veteran- Success and 
Gomparison Students (January Writing Exercise> 



Groups 


No. of 

Cases 


Means 


S.D. 


- -T -v aiu e 


Level of 
Significance 


Success 


50 


2,66 


0.92 


4.52 


Significant 
beyond .001 
level 


Comparison 


78 


2.02- 


0.84 





Summary: 



The t-vaiue of 4.52 indicates a highly statistically signifi- 
cant difference between the fourth grade veteran - Sue cess and 
comparison group writing achievement on the January writing 
exercise, in favor of the Su^ce^s group. 

Note: There appeared to be less _ "selecbing-out" of compositions 
across the groups on the fourth grade level, as evidenced 
from the numbers of compositions received for each class 
included in the sample. 
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Ob:1ectiv-e-it 4 



To measure the effectiveness of the Success Program in 

improving the reading attitudes of students participating in that 
program. f & 

In May, 1986 j. classroom teachers of the Success and com- 
parison third grade students included in the sample administered 
the Estes Readinf^ Attitade^Bcale^ a "Likert-type" instrument 
designed to determine the quality of the reading attitudes of 
respondents. The instrument is scored on a scale of 20-100 with 
higher scores indicating more favorable reading attitudes. 7/ A 
t-test was conducted to determine significance of the difference 
between ouccess and comparison group means on this measure. 
Table 11 displays the result of this analysis. 

Table 11 

Reading Attitudes of Third Grade Success and Comparison Groups 



Groups _ 


No. of 

^ a se 3 


— Means 


S.D. 


^-value . 


Level of 
Significance 


Sue dess 


185 


81 .82 


2.63 


2.31 


»* Significai 
beyond the .( 


eompi»ri3ori — 


203 


79.18 


^38 


level 



Summary: 

The t-value of 2.31 indicates a highly significant difference 
between the reading attitudes (attitudes toward reading) of third 
grade Success and comparison students of the sample, in favor of 
the Success grouPi The aoeoess third graders evidenced 
significantly more favorable attitudes toward reading than did the 
comparison third graders. 



7/ See Appendix D for a review oi the Estes Atbitude^cil es . 
including validity and reliability data. 
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As shown in Figure 3f postteat-pnly analyses of students' 

attitudes toward reading, as measured by the. Estes Reading Attitude 
Sealey conducted during evaluations of school years 19b1-a2, 
1994-85, and 1985-86 indicate that Success third grade students 
have consistently recorded higher average scores than comparison 
students . 

Figure 3 



SUGCESS and comparison STUdENTS 

ATTITUDES TOWARD READING 
(Trend of findings over three evaluations 




_ SUCCESS GROUP 

COMPARISON CROUP 



1981/82 198-f/aS 1985/86 

YEAR OF EVALUATION 



S6urc»;0CPS Suec»«« E vol. Scudy 1 oas-ao 



•Note: 



three evaluations referred to above involved 
a different sample of students. Therefore, some degree 

?r«.ir=^^Tif"°® '"^^^^^^^'"^^"t^t^l^ differences in 
group and individual characteristics (within-subject). 
It should be noted that this figure does not reoresent 
repeated-measures of the same students 
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Promotion/ rednitohdt^ ul^tlt for this sample, 

(grades 1A-6B) 5V3?emsfdep||cIn?^l!i"^P for eiementary classes 
retained, and identi?ied!-as having rlad°na^''^ 
computed for each groud ?f £®f °*^8 def iciencies were 

percentages of retention's, prollt ons''lnd'JL^If'' S"??"^' 

by group. h« amotions, and reading deficiencies • 

Table 12 

u^irmmiimsi si ^mwiimm^'^ comparison 



GROUP 



Success 



>ari3on 



(Grades 
1A-6B1 
W=i5, 782*1 



Prom oted 
Mtaiber/" 




3^»8 (95. 1J) 



375 (91.2J) 



33,206 (92.8$) 




15 (4. IX) 



30 (7.3X) 



2,576 (7.2$) 



19 



55 



(5.2X) 



(13. 4X) 
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Objefctive 5: (con't) 



Summary; 

Prbmbtibh/retentibh/readirig deficiericy data for Success and 
cbmparisbh group third grader^; and_third graders systemwide 
indicate differential proportions for each group. fts shbwh in 
Table 1 2, approximately 95% of the Success group third graders 
were proihoted , as compared to 91? of the cbmparisbh group. 
Approximately 4J of the Success group was retained, _as compared 
toTJpfthe comparison group i ln_ comparison of thesegrbups,the 
percentage of S^c-oe^ third graders promoted wasslightly greater 
than similar percentages computed for the other groups. Compara- 
tively , the percentage of Success third graders retained was lower 
than similar percentages for all other student groupings included 
in this analysis. 

Approximately 5% of the Su-cces^s third graders were identified 
as having reading deficiencies, as compared to 13% of the 
comparison group third graders. 
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To measure the effectiveness of the Success Program in 

improving the reading achievement of those fourth grade students 
having participated in the program for at least two prior con- 
secutive years^ as measured by the Cl^&S . 

Fourth grade Success students who had been exposed to the 
program in the second and third grades aswell as presently, 
(i.eo veteran- Success students ). ^ were selected for. the analysis. 
A t-test to determine the significance of variance between Success 
and comparison. group meahs_was conduc ted_ us ing available reading 
achievement (CTBS) data* The criterion level of statistical 
significance was maintained at d*G5i Data was collected for 78 
Success students and 19 comparison students. 

Notej^ Two comparison classes were dropped from the sample 
due to some degree of Success usei Table 13 below displays the 
result of this analysis. 

Table 13 

Reading Achievement of Fourth Grade Vet e ran -Suo£_ess and 
Comparison Students Based on Total Reading Scores 



Group 


No. of 

Cases 


MEANS 


S.D. 




LEVEL OF 


Success 


78 


59.39 


15.63 


2.58 


«» 


Comparison 


19 


49.42 


12.75 




Significant 
beyond 

.01 
level 



Summary : 



The t-yaiue of 2.58 indicates a highly statistically sighifi^ 
cant difference in total reading achleyemeht mean scores of the 
veteran- 5-acaeaa and comparison fourth graders, in favor of the 
Soocaeas groups A difference of approximately 10 points was 

readingachi eve- 
fourth 



^ group • AdifferenceofapproximateiylO 

observed. Veteran-Sueces_s fourth graders' total 

, significantly greater than that of comparison 



ment was 
graders . 



The total reading score is a composite of vocabulary and com- 
prehension subscale scores. Separate t-tests were conduc ted to 
compare the achievement of the two groups in each of the reading 
skill areas that were measured. Tables 14 and 15 below present 
the results of these analyses. 
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Table 14 



ReapS| Achievement of Fourth Grade. Veteran - Sacc^s-s and Comparison 
Students Based on Vocabulary Subscale Scores (CTBS). 



GROUP 


No. of 

Cases 


MEANS 


s.b. 


T-^VALUE 


LEVEL OF 
SlGNIFIGANe 


Su^ess 


78 


27.85 


7.65 


0.97 


Not 

Sighif ican 


Comparison 


19 


26;00 


6.81 





Summary : 



: . ^-"^^^^^ °^J^-97 indicates that there is ho statistically 

significant difference in Success and comparison group perfor- 
mance on the vocabulary subscale. Both groups performed at the 
same level on this measure. 



Table 15 

Reading Achievement of Fourth Grade Veteran- Success and Comparison 
students Based on Comprehension Subscale Scores (CTBS) 



OROU^^ 


NO, OF 
CASES 


MEANS 


— 3.0-.- 


T-VALUE 


LEVEL_OF 
SIGNIFICANCE 


Suecess 


78 


31 .57 


9.06 


3.ii3 


** 

Significant 
beyond 
.061 
Level 


Comparison 


19 


23;42 


10.22 



Summary ; 



The t-value of 3.43 indicates a highly statistically signifi- 
cant difference between S^2^.ess and comparison group performance 
on the reading comprehension subscale, in favor of the Sxic c ess group. 
These results identify differential performance of the groups in 
this particular skill area as being responsible for the 
statistically significant difference observed in the analysis of 
total reading achievement. The Success group demonstrated 
significantly greater achievement in the reading comprehension skill 
area than did the comparison group. 
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To measure the effectiveness of the Success Program in 
improving the language achievement of those fourth grade students 
having participated in the program for at least two prior 
consecutive years, as measu'^ed by the CTBS. 

As in objective six, d^ta for veteran- Su^ess fourth graders 
was analyzed, A t-test was conducted to determine the level of 
significance of variance between Succ^^^ and cdmparisbn group 
means on the language achievement measure of the CTBS. An 
analysis of the available total language scores was performed. 
Total language achievement scores are composites of mechanicr, 
expression, and spelling skill measures. Spelling data was 
available for 29 of the Suec^ss students. of the sample. There- 
fore, total language scores were available for that number of 
students. Language mechanics and language expression achieve- 
ment data for all 78 veteran- Success fourth graders of the 
sample was available. This data was available for 18 students 
of the comparison group. As in the analysis of objective six^ 
separate t-tests were _ conducted for each of the three language 
skill areas. Tables 16 through 19 present the results of these 
analyses , 

Table 16 

Language Achievement. of Fourth Srade Veteran-Suc^esj_ and 
Comparison Students Based on Total Language Scores 



GROUP 


NG. OF 

CASES 


MEANS 


S.D. 


T-VALUE 


LEVEL OF 
SIGNIFICAN 


Success 


29 


73.48 


13.30 


3.05 


Signif ican 
.004 ievei 


Comparison 


18 


62.64 


7.82 



Summary : 



. A difference of 1Q . 84 was observed between the two group means. 

The _t-value of 3 .05_ indicates a highly statistically significant 
difference .between Success and comparison group total-language 
means, in favor of the Success group. The total language achieve- 
ment of the veteran- Success fourth graders was significantly greater 
than that of the comparison fourth graders of the sample. 
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Table 17 



tanguap'.e Achievement . of Fourth Grade Veteran- g-u^^ss and 
Comparison Students Based oh Language/Mechanics Scores. 



OROUP 


HO. OF 

CASES 


MEANS 


-S.D. 


T VALUE 


LEVEL OF 
SmNIFICAMC 


Success 


78 




4.21 














2.75 


Significant 
.007 level 


Comparison 


18 


12.55 


2i79 





Summary : 

rw^ observed between the two group means. 

The t-vaiue of 2.98^indicates a highly statistically significant 
difference between Suecess and comparison group means on the 
^nSf«?!^-PT!u°" ^i^t^scale of the CTfiS. The language/expression 
^i^ltli L^^^ veteran-Success fourth graders was significantly 

greater than that of the comparison fourth graders of the sample. • 

Table 18 

Language Achievement of Fourth Grade Veteran- Success and Comparison 
Students Based on Language/Spelling Scores. 



GROUP 


NO. OF 
CASES 








LEVEL OF 


MEANS 




T-VALUE 


SIGNIFXC-ANCE 


S4Jccess 


29 


36.62 


5.36 




i« 










2.91 


Significant 
.006 level 


Comparison 


18 


31 .88 


5.51 



Summary : 

A difference of 4.73 was observed between the two group means 
on the Language/Spelling subscale of_the CTBS . The t-value of 2 ai 
indicates a highly statistically di f f erence~between Success and " 
comparison group means on the language/spelling subscale of the C^3S 

in favor of the Suee^ss group. The language/spelling achievement ' 

of the veteran- Sua^ess fourth graders was significantly greater 
than that of the comparison fourth graders of the sample. 
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Tabliei jg 

Language Achievement of Fourth Grade veteran- Succe ss and 
Comparison Students Based on Language/Expression Scores 



GROUP 


NO. OF 

CASES 


MEANS 


S. .D. 


T-VALUE 


LEVEL OF 

SIG-N-IF^ICANCE 


Success 


78 


22.57 


4.96 


2.98 


## 

significant 

.004 level 


Comparison 


18 


18.61 


5.62 



SUMMARY: 

A difference of 3.96 was observed between the two group 

means. The t-Value of 2.98 indicates a highly statistically 
significant difference between Success and comparison group means 
on the language expression subscale of the CTBS . The 
language/expression achievement of the veteran- Success fourth 
graders was significantly greater than that of the comparison 
fourth graders of the sample. 

Results of analyses of the individual language skiii 
achievement scores indicate that the veteran- Success fourth 
graders of the sample demonstrated significantly greater language 
mechanics, expression, and spelling skills than the comparison 
group. 
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to determine stt2deh"t satisfaction With the Suc^es^ Program. 

utritftn**fL^§''^^°""^='"^* "^'■^ mailed to aii elementary schools 
utilizing the Suceesa Program in Hay, 1936 to be administered bv 

fi«H^n?'"° 'n?°5ri '° '^''•'^ ^if^h. and sixth gride 

^^HH^nF n Imess schools. 16 schools returned completed 

^Jfi^J?^^"^T^^°[!"^^'"^^' ''^P'"^^^"^^"8 3 251 response rate (of 
ffi?^^ »^^H ° nn"?'"^'^ ^^''^^ questionnaires were received from 

r^.r^?^.;' .90 from fourth graders. 33 from fifth graders, and 
41 from sixth graders. ^Response rates by grade level based on 
average class size of 25 students are as fallows- third Irade 
fourth grade 19t. fifth grade 10X, sixth grade 15$ ^ 

arrrepo?ted°L'Tabl"SrSP°"^ '''''''' questionnaire items 

are reported in Table 20 by grade level. 

Table 20 

llu i;^!? Udi'imi ''' auestionnaire RespoSses 5f 



Questionnaire Items 





3 


4 


5 

(N=33) 


6 

N = 41 


I enjoy participating in the 
Success Prof^r^am 


97% 


100$ 


100$ 


93$ 


I would enjoy having the 
Success^rojiram eontlmiP. 


931 


97$ 


97$ 


95$ 


The program has helped me 
with other studies. 


37J 


97$ 


97$ 


95$ 


The Success Prof^ram has maHo mo 
more confident in my reading 


911 


9-1$ 


97$ 


33$ 


I read more now in my spare time. 


345 


32$ 


82$ 


73$ 


r enjoy working with a partner. 


391 


88$ 


79$ 


30$ 


Success has enablpH mo 
better . 


71$ 


63$ 


61$ 


68$ 


I enjoy individual help from the 
teacher . 


94$ 


33$ 


83$ 


33$ 
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Grade Three Studeats: 



Ninety-seven lierderit of the 207 third graders respohdingj 
reported enjoying participation in the Suecess Program; 931 
reported that they wOuld enioy having the program continue; 87% 
indicated that the Success PrOgrani has helped them with other 
studies; 91% reported feeling more confident in reading as a result 
of their Success participation; 84% reported reading more now in 
their spare time; 87% indicated that they enjoyed working with a 
partner in class; 88% reported that Success has enabled them to 
write better; 71% felt that they had sufficient time for writing _ 
during the instructional period; 9^*% reported enjoying the receipt 
of individual teacher help. 

Figure 4 shows percentages of Success third grade respondents 
selecting each module as that liked best. 



Figure 4 



THIRD GRADE SUGGESS STUDENTS 

ASPECT OF SUCCESS LIKED MOST 
(Percentage selecting each aspect) 




• 19 ID M 40 

Soupm: OCPS SueoMM Evol. Study IMS— M <N«007) | 
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or grade, student respondents reported enjoyment 

or tnesu£cep Program; 97% reported that they would enjoy having 
^?heritulf«^ continue and that the program has helpeS'theS wi^h 
Itt?[bSfe^lil jno^ reading, 

n" 3PSiiC£|ss participation; 82!t reported reading more 

Sith a n^rJn.^^'f'*^ f^'"^' indicated that they enjoyed working 

Wicn a partner in class and the same percentage reported that 
|g|£e|s has enabled them to write better; 63?'felt'that th^y had 
surficient time to write during the instructional period; 83% 
reported enjoyment of individual teacher help. 

-^i f?^-'"®^.^'^°"^ P^'"°^"^^8es of Success fourth grade respondents 
selecting each module as that liked best. 



Figure 5 



FOURTH GRADE SUCCESS STUDENTS 

ASPECT OF SUCCESS LIKED MOST 
(Percentage selecting each aspect) 



ENTIRE PROGRAM 
COMPOSITION MODUtE 




PHONICS/SPELLING MODULE 



RECREATlOMAt READING MODULE 



STUDY SKILLS MODULE 




i 
I 



0 3 13 23 iS i 

Sbui-c<i:DCPS Succaaa £.a. S:-ay 983-86 (M— 90) 



-38- 




50 



Grade Fine- Stad^nts^. 

33 fifth grade respondents reported enjoying the Success 

Program?. Niftety-aeven percent reported that they would enjoy the 
continuation of the Success Program, that the program has helped 
tnem.with other studies^ and that it has made them feel more 
confident In readings 82% indicated that they read more now in 
their spare time; 79S reported enjoyment of working with a partner 
in class; 85% reported that the Success Program has enabled them 
to write better; 6^% reported feeling that they have sufficient 

•.me to write during the instructional period; 88j indicated that 

•ey enjoy individual help from their teacher. 

Figure 6 shows percentages of Success fifth grade respondents 
selecting each module as that liked best. 



Figure 6 



FIFTH GRADE SUCCESS STUDENTS 

ASPECT OF SUCCESS LIKED MOST 
(Percentage seleetfng each aspect) 



ENTIRE PROGRAM 



COMPOSITION MODULE 



PHONICS/SPELLING MODULE 



RECREATIONAL READING MODULE 



STUDY SKILLS MODULE 




O 5 



2* w 4« aa sa 

S6urc«;DCPS Succjim jyql. Study 1083-88 (N-33) 
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Minety-ieight jjercirit of this 41 sixth graders responding 

reported enjoying the Success Prograinj_ that they would like for 
it_to continue and that it has heljsed them with other studies; 
83?. reported that the Success Program ha r. made them feel more 
confident in reading; 73S reported reading more in their spare 
time; 801 indicated that they enjoy working with a partner in 
class; 85X reported that the Success Program has enabled them 
to write bet^^.er; 68$ felt that they had liUfficient time to write 
during the •'.nstuctional period; 83* reported that they enjoy 
individual teacher assistance. 

Figure 7 shows percentages of Success six grade respondents 
selecting each module as that likad best. 



Figure 7 



SIXTH GRADE SUGGESS STUDENfS 

ASPECT OF SUCCESS LIKED MOST 
(Pereentcage seleeting eaeh aspect) 



ENTIRE PROGRAM 



WRITING MODULE 



CURRENT EVENTS MODULE 



RECREATIONAL READING MODULE 



STUDY SKILLS 




Sourc«:DCPS Succ»«» Evpl. Study 1883 — 818 (N— 
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Obj eoti ve 9: 



To determine teacher satisfaction with the Success 
Program. 

In Hay, 1985^ questionnaires^ to all Success 

teachers, Completed questionnaires were returned by 55 of 
191 pre-lcindergarten, kindergarten, and primary grade 
teachers us ing the program_, represent ing an overall response 
rate of 29?. A breakdown by grade level of the response, 
rates in the form of percentages is as follows: Pk-K (28?); 
Grade 1 (39%); Grade 2 (26S); Grade 3 (31%); Grade 4 ^26%); 
Grade 5 (15%); Grade 6 (36%). Quest ionnaire data analysis is 
presented for each grade level in the following tables with 
individual summaries for each quest ionnaire item following 
each table. An overall summary is presented at the end of 
the section. 

Pre-^kindergarten and kindergarten teachers 

. Table 2 1 displays the mean ratings by which_Pk-K 
teachers represented their level of enjoyment and their 
perceptions of the level of en joyment experienced by their 
students in the use of the Success program, by module. These 
ratings are on a scale of 1-7^ with 7 representing the rating 
of the highest level of enjoyment. 



Mean Ratings of PK and K Teachers of Their Perception of the 
Level of Student Enjoyrrent and Level of Personal Enjoyment of 
the Succe s s Modules 



Table 21 



( N = 1 1 ) 



Picture Word 

Association 

Module 



Alphabet; 
Module 



Oral Reading Story Time 
Module Module 



Teacher Means 



111 



6.8 



5.7 



5.5 



Student Means 



6.0 



6.6 



5.6 



6.6 
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Summary : 



Table 21 indicates that Pk-K teachers and students ^ as 

perceived by the teachers, enjoyed the Success modules to a 
high degree, PK and fC teachers reported that the Success pro- 
gram has improved the listening and speaking abilities of their 
students, With a mean rating of 6il8 on a scale of 1-7, with 7 
representing great improvement . One hundred percent of those 
teachers responding, report that their children are proud of 
their accbmplishrnents with Success > Ninety-one percent report 
that their students aretearhihg toassociate wordswith cangible 
items and intangible concepts in pictures more rapidly with this 
program than with traditional programs. Eighty percent of these 
teachers report that their students can read words printed in a 
variety of materials. Four of the eleven teachers identified the 
Oral tangtaage Module as a difficult for them to teach. Two of 

these teachers felt that this particular module does not hold the 
children's interest as it is formatted in the Success Manual » 
preferring lessons with visual aids. The_other two offered no 
explanation for their difficulty. Five of the responding PK and 
K teachers reported using the S^jccess program exclusively. 
Teachers reporting the use of other programs cite school. require- 
ments to do so, enrichment concerns , and half -day schedules as 
reasons. Eight of 13 (62%) PK and K teachers reported using at 
least three Success modules per_ instructional period, with only 
one teacher reporting use of _ill four mbdulesi Nine teachers 
of this sample (69X) report Success use at least 4 days per week, 
6 of them using 'the program daily. Four of the teachers 
responding expressed the .belief that students of the high achieve- 
ment level benefit most from the Success approach, with five report- 
ing the average achievement level, two report ing low achievement 
level, and one riot answeririg the item. Ail of the teachers^ 
responding, indicated an intent to continue use of the Succ eas 
program next years Table 22 lists the advantages and disad- 
advantages as stated by these teachers. 
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Table 22 



Ad'^^antages and Disadvantages of the Success Program as Stated 
by Pre-Klndergarten and Kindergarten Teachers 



ERIC 



No, Of 

tease rs Advantages 



(1) Children recognize words and letters more 
readily. They are able to identify more objects, 

(2) This fjrogram meets CBC guidelines, 

(3) The Picture-Word Module enhances the children's 
writing skills . 

(4) The Alphabet Module is thoroughJy enjoyed 
by the children. 

(5) The program is so versatile. 

(6) the Sug^^ss Program. meets the needs of 
children with Wide levels of abilities. 

(7) It develops listening :i*k:):lls, vocabulary , 
and helps to organize thinking and time 
elements. It also develops different 
language skills, especially the Story 

' Time Module . 

(8) The program influences certain developmental 
{growth) processes and results at these grade 
levels i 

(95 Children learn to read earlier and enjoy it. 

( 10 ) This program of fers an excellent avenue for 
expressive language, perceptual-motor skills 
and general readiness development. 
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Teachers 



(1) Difficulty in finding pictures for the 
Picture-Word Module without deviating 
from the recommended list of picture 
topics • 

j?ecominendatt^n^3-4^i^k--k Teachers 

Following is a list of recommendations offered by some 
of the pre-kindergarteh and kindergarten teachers who responded. 

(1) Correlate the topics under the Picture-Word 
Module with activities and skills taught each 
month. 

(2) Involve more children , that they might receive 
the benefits of this program. 

(3) I incbrpbrate the pictures from the current news- 
paper and the topics from the manual for the 
Picture-Word Module, rather than follow the daily 
outline. 

(4) Try using the Sweet-Pickleg ^t^d^ing Readiness 
Program with the Alphabet Module and the Picture- 
Word Module. 

(5) Somehow employ visual aids in the reconstruction 
of the Oral Language Module. 

Sumiiary 

Pre-kindergarten and kindergarten teachers responding 

report satisfaction with the_ Success Program. The bases for 
this determination are as follows: 

(A) Teachers registered high per sonal en joymen t 
ratings as well as high ratings of perceived 
student ehjoymeht in using the Suec-ess Program . 

(B) The greater portion of responding teachers reported 
using the Success Program at least 4 days per week; 

(C) The advantages to S ucce ss Program use, as cited by 
these teachers , greatly outnumber the disadvantages 
cited and indicate an appreciation and positive 
evaluation of the program. 

(D) fiecommendat ions are pro-Su£c_ess Program in nature 
and offer a variety of suggestions for further 
development and creative implementation of the 
program. 
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table 23 dispiaya mean ratings of teachers of grades 
1-6| representing the degree to which they perceived the Success 
Program as having improved the reading performance of their 
students. 

Table 23 

Teacher Perceptions of the Degree to Which the Success Program 
Has Improved the Reading Performance of Students (Grades 1--6) 









Grades 










1 


2 


3 


4 


5 




lean* 


5.41 


5.87 


5.5 6 


.6 


6.0 


5.0 


N = 46 


1 1 


8 


8 


5 


4 


3 



•Meahsbased upon ratings by teachers on a 1-7 point scale 
with indicating "Little Improvement and "7" indicating "Good 

Improvement", 

The Elemehtary_teacfier responses in the form of the 
raean_rating3 reported above indicate that for those teachers 
responding, the Socaesa Program was considered as having 
improved the reading performance of their students to a 
relatively great degree. 

Table_24 reports the achievement level of students 

perceiyed_by_ teachers as benefiting_fflpst by the Success 
Program approach, by grade level. Table 25 indicates teacher 
responses regarding the number of days that they utilized the 
Success Program each week. 
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Table 24 



Achlevenont tevel of Studehta Benefiting Moat From the 
Succaaa Program 



Level of 
Achtevefflent 


Number of Respondents By Grades 
1 2 ^ 4 q fi 


Percent 














n = 3 




HiKh 





^ 


2 


2 




1 


44 


ftverase 






6 






2 


44 


Low 




1 










3 


All Levels 


1 




2 


3 






17 



•Note: 



Calculations of percentages are based upon 36 responding 
teachers. Several teachers indicated more than one achieve- 
ment level. Therefore, total percentages exceed 100% 



Table 25 

Number of Days Per Week Success Program taught By Grade 



Days/Week 


Number of Teaoher^s Bv Grade 


1 


^2 




4 


5 




% 




(n=1 1) 


(nr3) 




(n=5) 


(nrl ) 






1 

2 
















3 


4 


1 


1 






1 


19 


4 




3 


3 


2 




1 


25 




7 


4 


4 


3 


^ j 


1 


56 


Total 


1 1 


8 


A 


5 


1 1 


3 


100 



Teachers of this sample not using the Success Program daily 
indicated the following reasons for not doing so: 

Grade- Qfte 

(1) Attention span of my group of children influence^; 
my not using it daily. 



(2) I needed to use a different approach with my slow 
learners . 



.^8 



Grade One (con't5 
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(3) I was required to show evidence of basal reader 
use by every students 

Grade Two 



(4) I needed to spend more time on other skills such 
as social studies and certain math skills. 

(5) We use one day for testing and the teaching of 
test taking skills. 

(6) Computer laboratory and other special activities 
cut into my Success time. 

Grade Three 

(7) Fridays are used to test and review SPP skills 
for the week. 

(8) Ghildreh go to various resource personnel and 
special classes • 

(9) We have assembiy programs on Fridays 9/10 of the 
time. 

Srad^-Four 

(Id) Testing on Friday of skills covered during the 
week interferes with the Success schedule. 

(11) Special classes prevent us from using the program 
daily . 

Grade Six 

(12) Special classes are held, usually on Friday. 

(13) The school's scheduling posed a problem. 
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Thezgreatest number of respbridihg teachers from gradii_1 
through 5 reported using the program five days per week? 56J 
of all of thm taaohers responding reported daily use, across 
all grad# levels. No teacher reported using the Success 
Prograa lesa than 3 days per week. 

Table 26 displays the number of teachers, by grade level, 

reporting the teaching of each of the Success modules during ' 
their instructional periods 

Table 25 

^umber of Teachers Teaching All Success Modules During Instruc- 
tional Period by Grade* 



Response 


Number of 


Teachers Bv Grade 






l3t 




3rd 


4th 


5th 


6 th 


Pet* 


Ifes, all oibdules tausht 


^? — i 




7 


5 


1 


2 




No* all modules are not tauK^t^ 




0 


1 


G 


0 


1 


1 1 


















Total resDondtnff 


1 1 


8 


a 


5 


1 




100 


PercentaKe/fii-^afte-AiL Modules 


32 


100 


88 ■ 


100 


100 


h 





Eighty-nine percent of the responding teachers taught all four 
Success modules during their instructional period, across all 
grade levels. 

Table 27 reports the number of teachers that indicated 

having problems in incorporating the Success Program with the 
Student Progress Plan, by Grade Level^ 

Table 27 

Problems Experienced by Teachers in Incorporating the Success 
Program With SPP, by Srade Level 





Response 


N4Jinber 


of 


Teachers By Grade _ 








1 


2 


3 


4 


5 




Pet. 




Yes, had probieos incorporating 
SPP with Succeas 


2 




1 




1 


1 


14 




Mo, didn't have problems in 
incoroorating SPP 4j^ith Success 
Total 


9 
1 1 


OQ CD 


7 


5 
5 


f 

1 


2 

3 1 


86 

100 
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Table 27 indicates that of the_36 teachers responding^ 
only, five reported, haying. any prgblems incorporating the 
^43^^ g r am With the Student Progress Plan. Eighty-six per- 
cent of the responding teachers reported not having any problems 
in incorporating the two programs. Fbllowihg is a list of the 
problems reported by teachers, by grade level: 

Grade One 

(1) Children in transition (especially in September) 
have to be ready for second grade by mid-year. 
Thay must have second semester skills at the 
beginning of schools 

(2) Have problem with materials that are made 
available . 



Grade-Three 

(3) The timing of the teaching of the modules is not 
coordinated with the end of the advisories. 

G r^ e- FiAre 



(4) Checklists are a problem in that it takes a 

high degree of organization to use basal readers, 
reading CBC guide, and the Success Program (but 
I tried). 

Grade Six 

(5) The Success Program does hot lend itself to the 
continuity of the SPP. 
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i.u o*^^^-® displays the narhbers of teachers indicating use of 
the guccess Program exclusively in their reading instruction 
and those who did hot. 

table 28 

Frequency of Exclusive Success Pro gram Use 



Response 




Nufflber 


of 


Teachers 


By 


Grade 










1 


2 


3 


4 


5 


4 - 




Yes, using only St 


jcces^ 


5 


6 


2 


? 


J— 






No, hot^using Succ 


iess only 


6 


2 


6 


1 




3 


50 


No response 
Total 


1 1 


8 




5 




3 


6 

100 



- Table 28 indicates that more responding teachers on the 

first, third, and sixth grade levels report not exclusively 
using the SwsGeas Program in their reading instruction. The 
proportion is six to two on the third grade level. All three 
sixth grade teachers responding, reported not using Success 

exclusively. Forty-four percent of all primary teachirs 

responding, reported using the Success Program exclusively, 
during their reading instructional period. Fifty percent 
of the teachers reported not using Success exclusively. 
Following is a eoraprehensive listing of advantages and dis- 
advantages of the SuGxxess Program as stated by the primary 
grade teachers in this sample, by grade level. 

Of the 36 teachers responding, only two indicated that 
they do not intend to continue to Use the Success Program 
during the next school year, one of which is a kindergarten 
teacher, the other a first grade teacher. Four teachers of 
the sample indicated that they were undecided at the time of 
questionnaire completion„ Two of those teachers taught on 
the first grade level, the other two on the third grade 
level. Eighty-six percent (86?) of those responding, intend 
to continue Sue seas Program use next year. Tables 29 and 3D 
list advantages and disadvantages of Sucaess Program use, as 
stated by primary teachers, respectively. 



-50- 



B2 



ERIC 



Table 29 



Advantages of Success Program. as Stated by Elementary Primary 
Level Teachers, by Grade bevel 



Ho, of Teachers 
by Grade* 




Advantages 


6rade t 


(a) 


You are able to work with the entire class 
at once. 


4 


(b) 


Success motivates even the slowest child to 
want to read* 




(c) 


There is no basal reader you must stick with. 




(d) 


It gives every child, regardlessbf their 
ability, art opportunity to experience success 
no matter how small the success. 


2 


(e) 


It increases the language experiences of the 
children . 




(f ) 


Success allows for creativity on the parts 
of the teacher and the children. 


3 




It allows great flexibility. 




(h) 


it allows children to experience immediate 
success . 




(i) 


Children are able to write sentences. 




^ 3 ) 


It is very easy to relate the Oral Language 
Module to science and social studies. 


3 


(k) 


There are so many skills that can_be taught 
from the modules , especially the Phonics/ 
Spelling Module^ which I relied on heavily. 




(1) 


Success provides an already-planned daily 
reading program. 



* Absence of a number indicates that only one teacher expressed 
this point of view. 
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Advantages (con * t ) 



Grad^^ (a) Success allows flexibility in subject matter. 

Cb) It allows freedom of expression from teacher 
arid students . 

(c) The program frees time that would be spent 
checking papers, planning, etc. 

(d) This program produces fluent readers^ 
proficient writers, teaches life skills^ 
builds confidence, improves self-image, 
improves attentiveness^ and allows for student 
as well as teacher creativity. 

(e) The modules are interesting, easily adaptable 
to any curriculum. 

(f) Pupils become sophisticated spellers , 
writers, and readers, due to the variety 
of materials used. 

(g) It strengthens dictionary skills. 

(h) It promotes sight reading. 

(i) Success teaches children how to read a news- 
paper i 

(j) It allows children to explore magazines 
and many types of reading matter. 

(k) This program induces and encourages cl... r.s 
participation . 

(1) It helps teacher to pace time in instruc Ion. 

(m) Students are able to work at their own rat-^. 

(n) Children learn organizational skills throug': 
the use of folders and notebooks for wor . ' 



*Absence of a number indicates that only one person expressed ti.^i: 
point of view. 
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Teachers by 
Grade* 



(o) The program helps weaker students lose their 
fear of failure. 

(p) Reading is made more personal and 
relevant to current events and the 
childrens and teachers lives. 

(q) Parents get more involved. 

(r) Writing skills are enhanced. 

(s) It is very well correlated with the 
SPP objectives. 

(t) It is a great reinforcer for all skills. 



•Absence of a number indicates that only one person 
expressed this point of view. 
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Table 29 C.con't) 




NO Of Teachers " -[ 

by Cradaf - Advantages Ccofi't) 

(a) Success builds vocabulary. 

(b) The program encourages oral participation. 

^nH^^S???" ^'•^^tivity greatly (teacher 
and children) . 

(d) It heipa children be55rne aware of the 
parts of the newspaper. 

(e) It enables the children to be exposed 
to .nany facts. h'-'^cu 

(f) The children and the teacher love it. 
'"^ I?tJrifir?^°^ utilizes a variety of reading 

(h) it use^ everyday materials to teach. 

(i) It teaches SPP skills. 

(j) Success, highly motivates the students, 
(k) This program allows for individual differences 
(1) It uses whole-group instruction. 




(a) The Success program allows each child to 
experience success on his/her individual level 

(b) It correlates with the SPP skills. 

^^^provides structured experiences in various 
media for developing skiUa in all ar«as 
of reading and language arts. 

(d) Success provides more opportunities for 
positive responses 

(e) It encourages better oral and written 
expression . 
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No. of Teachers 
by Grade* 



Brade 5 (a) Children are able to see word parts and 

how they are related. 

(b) Spelling improves. 

(c) Writing skills are enhanced through 
increased practic e i 

(d) Lessons are easy to use and the manual 
is easy to follow, 

(e) Children read a lot. 

(f) Current events are di'^cussed daily. 



Grade 6 (a) Suc-cess provides enrichment. 



(b) Children have first-hand in formation 
and references . 

(c) It covers a great variety of skills. 
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table 30 

S^^a^v.anfcages of Saccess Program ds Stated by Elementary 
Primary Teachers, by Grade Level. 

No. _of Teachers ~ ~ " 

fey Grade BtsiAvantagea 



^ Ca) No supplies are given for this program. 

Cb) Whole group instruction is a dis- 
advantage for some students who 
require a smaller group, more time, 
and more hands-on experience to get 
; better grasp of any subject matter. 

(c) Children heed directed reading. 

(d) In open-space, children sometimes tend 
to get noisy when doing the Phonics/ 
Spelling Module and ACC Module. 

(e) Jhis program is rigid for slower students 
You tend to lose their interest. They 
can't seem to sit through all of the 
modules . 

6 (f) None 



Gj-ade 2 

7 (a) None 



(b) It is difficult to teach all modules on 
heavily scheduled days, due to special 
classes, etCi- 



G-T^ad g 3 

^ (a) None 
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(b) It is difficult to teach all modules in 
the aiioted time. 

(c) It does not provide time for teaching a 
new skill. 

(d) The program didn't allow enough time for 
completing writing skills in composition. 

(e) The time limit in spell ing doesn ' t allow slow 
students to complete or copy words. 
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.No,_df Teachers 



by Grade* B i s a d jantage^^Ccont ) 



Grade 4 (a) Children often. don't want_ to stop, 

throwing your time schedule off, 
especially when you're attempting 
to encourage those who often don't 
respond well • 

3 (b) None 



Grade 5 (a) A^$ubstitute teacher will find it 

difficult to teach alesson, using 
another method of instruction. 



Grade 6 

2 (a) None 



(b) Skills covered are not necessarily the 
skills necessary to accomplish mastery 
of SPP list. 
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Recbibinehdatidhs of Sncce ss Program teachers by Grade Level 



No. of Teachers 

by Grade* Recommen dations 



Grade 1 


(a) 


X am going to form a grade level Suce^^ 
Club to share ideas once a month. 




(b) 


I would provide more hands-on experience, 
more manipulative objects. 




(c) 


"vuxu A 11 V- u I jjo 1 d t. e sQuie type oi uirected 
reading module. 




(d) 


Incorporate more illustrations in the 
Phonics/Spelling Module and give students 
added variety to this module. 




(e) 


I see no need to change the program. 


Grade 2 


(a) 


Revamp content areas to coincide with SGb^S 
curriculum guides (i.e., math, science, 
social studies, and some literary arts). 


• 


(b) 


Have periodic meetings for sharing of ideas, 
even for teachers who are veterans of the 
program. 




(c) 


Production of a booklet of new exciting 
ways in which Success teachers have used 
the program, incorporating math and science 
would be useful. 




(d) 


Cut back oh filing. 



^''^^^ 3 (a) Give a refresher workshop to show how 

resource or special subject teachers can 
incorporate Succ^^^ in their programs. 



(b) I wouldn't change the program. 



(a) Teachers should exercise the amount of 
flexibility the program allows to adjust 
their teaching to meet the specific needs 
and abilities of the students. 



(b) Coordinate program to blend with SPP. 



Grade 4 



Grade 5 
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Obje^lve 10; 

i-h* ^.^J-^^^^pi"^ eieSentary principals' satisfaction with 

the Success Br^f^r^m, as determlried from questionnaip-e Responses 

_ Twenty-one elementary school principals of a tnfs^ fit; 
?^turnIJ'' participating in the Success Pro^rM 

returned completed questionnaires, a respon se rate af T'-^i 

Ju^.m''°^'"S P'-^^^"^ data'relative to principal 

questionnaire responses. t^' -LUdpaj. 

Table 32 

Mean Ratings Of Principals Regarding Improvement in 
Student and Teacher Abilities. 



_ Area_c 'c^Jmpr^vement Mea^ ~Riti7rgf 

Reading and Writing Abilities of Success Students q p 

-aaching Abilities of Success Tea chers ""^"^^"^^ |-| 

Mean R a tjlflg Both Areas # 

"iM^rL'"^^^"!.^^ principals is based upon a scale of 1-7 with 
impr'oveSen?!"' improvement" and "7" representing "great 

^^..J^^^^^^^^^^^^^^^^^^P^e r&poried in their ratings that 
jhildren participating in the Success Program have shown more 
^^nS^^Hf '""^^"^ '"^ w'-iting abilities thin children 
l^hoofi Tfil lL''''^^-^ being taug.t at thei" 

schools. Th^ mean rating was 5.2 Principals of this sample 

?l^r-l^°''u^'^ '"T^ improvement of the teaching abilities of 
e?Ts ThJ':' ""^^ S'" t^^ Suocess Program With a mean bating 
cf 5.5. The mean rating for both considerations combined is 5.4. 

related^th^r^H^'' ^^I!^ responding principals 

related that other reading programs are in use along with the 
|u|ci^ Program. Reasons for other program use alftated by 
the principals are cited below: ^ 

continuity of instructidn throughout the 

Dui±aing. 

(2) To continue exposure to varying skills and 
broad-based data offered by the series we have used 
for several years. 

(3) Thf. teacher felt thai: some pupils showed great 
strength when a small group basal text approach was 
also incorporated into the reading program 
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(4) We are directed by the school system to have a 
more _ structured reading program, . Success in 
Reading was a perfect compliment to our structured 
reading program . 

(5) Pevisibpment of comprehensibh skills cali'^ for 
iricbrpbrat ion bf bther methbdsi 

(6) Teachers have elected to use other programs as 
ah eclectic approach to teaching, 

(7) Teachers often feel more comf ortabl when using a 
basal approach to teach reading. 

(8) Participating teachers are not soioly committed. 

(9) chers LJsed modified 3y^e^s approach in which all 

modules are not taught. 



Table 33 presents data concerning the nature of lAe 
joint use of Su^soess and SPP reading programs, as view-r-rS by 
principals. This item concerns the cJ ent if icaticrj of r/rotliK^ 
in the associative use of the two programs. 

Table 33 



Incorporated Use of Succes s and SPP Prbgrarns as Reported by 
Principals 



SPP and Success ProRram Use 


No. of 


Percent 


0 No problems encountered 


18 




0 Problems were encountered 


3 


mi 


Total 


2A 


100? 



Eighteen Of 21 (86%) of the principals responding report 
that no problems in the associative use bf the Success 
Program and the SPP program of stuoy wjre encountered during 
this school year. Three prir^ipals reported that there were 
problems related to this association . at their schools. Following 
is a list of the types of problems cited by those principals: 

(1) There are students and parents who feel that a 
textbobk (basal) is needed^ Many comprehehsioh 
skills are felt to be undeveloped in the Sud^eis 
Program. 

(2) Teacher creativity and effective planning are 
prescribed for programat ic integration. 
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Success Use (con»t) 

(33 Time is needed to provide staff deveiopmeht 
for teachers. 

Nineteen of the 21 (90jt) principals responding indicated 
an interest in the continuation of the Success Program at 
their schools, with but two indicating the contrary. No 
reasons were given by those two principals^ for their lack of 
interest in the continuation of the Success Program at their 
school. Table 34 following presents a list of advantages to 
using the Success Program, as stated by responding principals. 
Table35 lists disadvantages i 

Table 34 

Principals' Statements of Advantages of the Success Program 



Advantag es _ Nq, of Principals 

(1) There is no basal reader that a teacher 
has to stick with. 



(2) You can work with the entire class at 
once • 

(33 Variety in materials and experiences are 3 olus. 3 
(43 Students are encouraged to write. 

(53 This program provides opportunity for students 2 
to handle newspapers^ development of 
searching techniques, and :dev< ^opmeht 
of realistic reading and language arts 
skills in a creative instructic .1 method. 

(6) It improves the reading scores of the 
children involved i 

(73 Children are enthusiastic about the 2 
activities . 

(83 We notice ah improvement in writing and 2 
spelling skills, 

(93 Students are provided meaningful reasons 
for reading and writing. 
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(10) The program allows for maxirnum 
skill and subject matter inter- 
gratlon* 

(11) Very young children are successful 
in reading printed materials 

(12) Success provide**^ a "road map" for instruction. 

(13) It increases vocabulary used daily by 2 
children . 

(14) It requires students to think and sharpens 2 
this skill. 

(15) Students are able to progress at their 
own rates , increasing self-confidence. 

(15) Students improve organizational skills 

through the use of folders and notebooks. 



(17) Success motivates teachers in allowing 
them to do new things. 

(18) Teachers trained inthe use of this 
program seem to_ utilize more creative 
and motivational methods and techniques. 

(19) Use of the Washington Post newspaper is 2 
excellent^ broadens interest in newspapers. 

(20) The program gives all students an opportjpity 
to develop greater use of oral and written 
language . 



Principals-! Siyau 


Table 35 
tements of D4r^4 vantages 


of Success Proctram Use 






Disa^lvantages 


No. of Principals-* 



( 1 ) Amount of display space needed is greater. 



(2) The scope of the program is not extensive 
enough to provide enough skills, when using 
it exclusively. 
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(3) Ho disadvantages 



14 



(4) It doesn't provide sufficient 

review and practice for slower learners. 
Skills are introduced too rapidly for 
his particular group of students. 

(5) More tinie_ is needed for appropriate 
implementation • 

(6) Students are expected to read from 
a basal reader. 

(7) Teachers often fail to be as consistent 
as is needed for skill maintenance. 

•Absence of a number indicates that only one person expressed 
th is p oint of view^ 

table 36 presents ^ comprehensive listing of the recommen- 
dations offered by principals who responded, concerning the 
Success Program* 

Table 36 

Recommendations of Success Principals for the Success Program 



ReGommendations 

(1) Provide more monitoring by the Success staff. 

(2) Continue to provide funding to provide newspapers. 

(3) Train more and more teachers in how to use the program. 

(4) Use S uccess in conjunction with a basal reader textbook 
approach. 

(5) Continue to provide workshops for training new teachers 
to help them to impiemeht the program properly. 

C6) Utilize Success Program 90J and basal reader 10J. 

(7) There should be provision of positive feedback to i „inforce 
teachers through visits to the classrooms by Success staff- 
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Stiihiriary of Principal Data: 

Success principals of this sample report satisfaction with 
the Success Program, Following are the bases for this determi- 
hatioHi 

(1) Mean principal rat ing of improvement in reading and 
writing skills of Success students indicates a relatively 
great degree of improvement. 

(2) Mean principal rating indicates a relatively great degree 
of teaching ability improvement for Success teachers. 



(3) Very few problems in the associative use of the Success 
Program and SPP are cited. 

(4) Many more advantages of the Success Program than disadvan- 
tages are cited by Success principals. 

(5) Ninety percent of the reipondihg Success principals expressed 
the intention to continue Success Program use at their 
respective schools next year, 

(6) Recommehdatiohs offered by the Success Principals responding, 
are of a pro- Success Program nature. 



/'6 



Limi tat io r^s : 



o Lack of randomization in the self-selection. of 
vdlunteer sampl irig imposes a "selection by treat- 
merit" interaction Which, threatens external validity 
(generalizability 3 of the findings. 

o Effects of the Success In Reading and Writing Program 
upon criterion variables (reading, writing^ and language 
achievement 3 are likely to be con found ed with other 
ihstructiohai factors, due to varying degrees of actual 
Success program implementation (as the program is designed). 
Two thirds of the principals_responding, indicated that Suoc-es^^ 
was not "purely" or exclus ively used, making true measurement 
impossible . The wide range in number of S^j-q ce^ s lessons 
reportedly taught by responding teachers also indicates 
lack of uniformity in program implementation. 

o Small sample sizes in questionnaire analyses warrant 
caution in generalization of findings. 

o Differential motivational factors associated with each 
of the topics in the pretest/posttes t Writing analysis 
is likely to be responsible for an unexplained amount of 
variance in treatment group measures. 
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lecomffi^ndatibns of the Evaltiator ; 

^ Analysis of data gathered in the present evaluation of the 
Success Program indicates heed for the following: 

(1) Continued encouragement of Success teachers to teach 
each of the Success ^^ogr^m modules at least 4 days 
per week (i.e., as close to the design as poss ib 1 ) . 

(2) eohtinued provision of workshops, demonstrations, and 
meetings of Sus<;^ss Program participants and potential 
Sttccess participants to further sharpen teacher 
competence and to increase confidence in this approach. 
This may also serve to facilitate the further refinement 
Of methods and creative nuances introduced and developed 
by teachers, as well as the sharing of these. 

(3) Continued efforts by principils to schedule special 
subjects, programs^ and activities so as not to disrupt 
or interfere with Success instructional periods to allow 
for the implementation of the program as it is designed. 
The actual impact of the Success Program , or any other, 
cannot be accurately measured unless it is implemented 
as designed and implemented reliably. 

(it) Continued efforts to in/olve teachers of the fifth and 
sixth grade levels, so that (possible effects upon 
achievement related to continuity of Success exposure) 
across ail elementary grade leve's might be observed 
and evaluated. 

(5) Continued comprehensive evaluation to determine program 
effectiveness upon student achievement. 
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Pre • kindergarten and Kindergarten Lessons 



The fol lowing gives examples of a one-day program for grades Pre-k^ 
if 2i 3i 4p 5i 6 and junior high* 





PHASE I 


PHASE I 


PHASE I 


PHASE I 


LESSON 


PICTURE/HORb 
ASSOCIATION 


ALPHABET 
FORMATION 


PUPPET PHRASES 


STORY TIME 


i 


Story characters 


1 


telephone talk 


a name 


2 


animal s 


t 


toys 


a place 


3 


bul 1d1 hgs 


f 


food 


a verb 


4 


kitchen 


h 


playing 


a nana 


S 


landscapes 


d 


tel evi slon 


an adjective 


6 


furniture 




safety 


a time 


7 


feet 


j 


pretty things 


something that happened 




story characters 


ic 


school 


a name 


9 


food 


P 


animal s 


something ti'at caused 
something to happen 



ERIC 
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APPENDIX A 
Saniple - Success jljl 
HTogram Lesson Plan*; 



SO 



Srade i 



9:15 - 9:45 



9:45 - 10:15 



M6duJe^ 
Phohlcs/Spel ling 



tangdage Experience- 
Envlponnent: Houses 



10:15 - 



10:45 I Academic, Cultural Arts, 
j and Current Events 
Reading- News papers: j.,1 . 



10:45 - 11:00 
11:00 - 11:30 



Rest Period 
Patterning - ho. 



11:30 - 12:00 



Recreational Reading 
Library Books 



"Actlvjjtj 

Write on chart paper word clusters 
suggested by tfie student that con^ 
t^in r. Pronounce each wo rici 
Students write the letter r and 
vords containing r. OiscoTs the 
meanings. Ex: £3 ise your hand, a 
hard rock, fi£e t£uclc siren. 
Students date and file pTpers. 
Display chart in classroon. 

Write on board word clusters sug- 
gested by students concerni^ 
housesi Students cut a picture of 
a house and label its parts. 
Ex»nple of vocabulary; slanted 
roof, red brick chimney, patio 
door. Students begin a story about 
houses. Studentsdate and rile 
papers. ^ 



Students cut or tear the letters l 
1 . and words containing thise 
letters fran the newspapers. 
Paste. Check each student for 
recognition of L. J,. Students date 
and file papers. 



Write on chart paper different- 
endings for words beginning wi^th 
ho. -Ex.: ho£, hocky, honk, 
hospital. Stress Emp ha sTsj vocal 
stress on one word near beginning 
of sentence. Display chart in 
classroon. 



Help individual 
pronounce words 
that contain £. 



Students find and 
in library books 



Source: ^„e h. Adams, Success in B^ 1nninn d^h... uritiia- tS. 
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Grad« £ 



kesson I 





Tlfiift 


Module 


Activity 


9: IS 


- 9:45 


Phonics/Spel 11 ng 


Letters to bestudifid,b, c. 
Students give ©tampTes of: sfngte, 
one-syllable words (minimum of 10 
with each lettep) 


9:45 


- 10:15 


Academic, Gultupal 
Arts, Guppent Events 
Readi ng 


Areas: Science 

Global Reading Theme: Locating 
Information about animals. 
Materials: Science textbooks, non- 
fiction books. 

Writing Assignment: List animals 
and infonnatidn found about each. 


10:15 


- 10:45 


Language Expeplence 


Theme: Writing About Fun 
Segment Writing: Any topic. 
Maybe related to the theme. 
Writing Skill: List, 
rroor reaui ng i nrusu: iiame ana caue 
on paper correctly. 


10:45 


- 11:00 


Rest and Relaxation 




11:00 


- 11:30 


Recpeational Reading 


Inilyldual teacher- student 
conferences, decode and discuss 
vcrds containing "b" . 



Soupce: Anne H. Adams and Helen Cappleman, Success in Reading and Wpitihq ; 

gpade 2j (Santa Monica. Galifopnia: Goodyeap Publishing Company, 
Inc., 1978), p. 3. 
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Grade 3 



Lesson ^ I 
Time 



9:15 



9:45 



9:45 - 10:15 



10:15 - 10:45 



10:45 • 11:00 
11:00 - 11:30 



-Moduli 



Decoding in 
Context 



Academic Cultural Arts 
Current Events Reading 



Composition 
Fluency/Accuracy 



Rest and 
Relaxation 

Recreational Readi ng 



Activi ty 



Ph^se_l : Lessons 1 > 40 . 
SpeJ li ng Emphasis t 
Grammar Emphasis common nouns 
sci ence 

Cycl e I ' Ear rint-E^ents 
Thene : P-eopI in the News 
Ma teri al s : rliws pape rs 
Readi ng Ski 1 Is: Association of 
i nfo rma tidn 

Read about people and write 
names and titles. 

Phase I (Lessons 1 - 90) 
Cycle I 

Theme: Classification of Lifc^ 
-Items ~" ' 

Sub-theme : Things seen on the way 
to school • 
Mode: Lists 

Proofreading Thrust: spelling of 
^ome words on li st. 



Skill Focus I 
Locating title of book 



source: Anne^ H.^ Adams and^ Helen Cappleman. Success in R^.dinn .nH y.....^. 3 
(Santa^Momca. California: Goodye ar Pub h shing Company, Inc.) 
p p • b • 
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grade 4 



Lesson I 


Time 


Modul e 


Activity 


9:15 - 9:45 


Phonics/Spel 1i ng - bl 


Phase I Introductory Phase: 
Lessons 1-19 

Spelling Emphasis - Two letter 
Gbrisbriant Clusters 


9:45 - 10:15 


Compos i tion 


Cycle One: Writing 
Descriptions and_ Cdmpari sons 
People - Physically, Actions, etc. 

Materi als : Nev^s papers 
Writing Assignment: Write 
sentences describing a classmate. 


10:15 - 10:45 


Study Ski 1 Is 


Cycle One: Alphabetizing 
Theme: People 

Material: Science Textbooks 
Readi ng Assignment: Read to find 
names of people 

Writing Assignment; M a list 
of names and alphabet rhe names. 


10:45 - 11:00 


Rest and Relaxation 




11:00 - 11:30 


Recreational Readi ng 


C>' le One: Teacher establishing 
model 

Everyone, including the teacher 
reads fiction or non-fiction books 
s il ehtly . 
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Grade 5 



LESSON 50 

PHONICS/SPELLIHG 


eOHPaSlTION 


m SKILLS 


brtLtlNb tMPHAMS: 4t 


PRE-WRITING TOPIC: 


- - 

eyelfiiix: Charts^ firaphs 


c-j s-^fiidoies in pirjgrspns 


Hy Hagic Pencil" 


tables. 




miTING ASSIGNMENT: 


Sledge AREi». metric 


yfirinillJDV CMDBACtCi 


Students write a creative 


systeffl 


\ trtu J 


- 

story about a magic pencil 


REAjjlflG/ilTlNG FOCUS: 


rinlLl\InL, IlcWjUdUcr 


PRUU-KtADlNS THRUST: 


using a math book read to 


HHMf OflDS' • lie inn C Ifl 

nuPlLrlUnK, using D-jt) 


adjectives de/ 'bin§ the 


locate charts and/or graphs^ 


words frdn ehaf'^ (ip<;inn 


[JcilLI 1 a 


_ _ 

tables using the metric 


i Duzz 6' criK5word ; 




syster. List the metric 


seek/find 




teniis. 






Teeehermay wish to explain 






meaning of chart, graph, 






tables. 



RECREATIOi REii^s 



SEE LESSON 41 
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Grade 6 













Cycle 11: Weather 
HATER lAL: Newspaper 
mmm\ precipitation 


HATERIAt: History book, 
encyciopeoiai 
and almanacs. 

» SKILL: locatinq 


Cycle 6: 
COHPREHENSiefl: 


tiioi dbbci ifcQt ion 


MLli: -lit, -is 

HECHANICS: Cdiiibining 
noun Phrases 


cities with 
largest 

given area. 


Suffixes 


in subjects 


STUDY SKILL: 
Synonyms 


mMm Volunteers 
recite 
ad Vert is i no 
slopn. 

1 


See Lesson 1 


READING: Read to determine 
^ich city in your' 
area is laigest. 


See Lesson 11 



WRITING: 



or a sales- 
pitch to 
adve lise a 
prc-tluct. 



§rnN6: Write a paragraph 



reasons for city's 
growth. 
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EVAtUATlON DESIGN 
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R9 



HETHOD OF ANALYSIS 



leasure the effectiveness of 
Sgccess ptbgram in improving 
feading performance of the 
entr; participating in that 
ram. 



Norm-referenced reading test 
scores of Success. third graders 
will be compared to scores of 

analysis of the sample data on 
ydcabulary and comprehension 
neasures will be performed 
Qstng the analysis of 
y^riancL jANbVAj procedure* 
Similar analystSi using this 
^!;§^Ai^^cal prpcedurei vili be 
conducted on composite reading 
Bcdresj.^ (vocabulary and cgm-: 
par Isoh) Success and comparison 
atudentSi categorized into high, 
average; and low achievement 
levels will be compared on norm- 
Referenced achieyemert test per- 
formance in the areas of vo^abutiiir^ 4 
co'^Pfehensiori and their com- 
posite (total reading scoresj . 
The Analysis of Varlanceprp- 
cedure vill be used to observe 
main effects of the Succeas pro- 
9^^ni and interactions betweer 
treatment and achievement leviei. 
Criterion of significance is set 
at a.B5. 



to eiv'vj;/' , 

Diagr.fi :t • :d Pre- 
flcrip^;»'i> .rar; ronjent 
<D,P.I) : be used 
inachiovT nt level 
categorization. 



PROGRAM/SAMPLE 



Reqalar third grade 
^^fC5f>&6ej asses 

< ■ jptet I schools 
id<u.: ;ifi^(J as high 
i pit^ 1 e :n e n t e r B ^ae- 
<SH) of the Success 
program and regular 
third grade classes 
f rein hon^-Success 
Chapter I schools. 
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~ " • HETHOD of AfJjlLTSIS 



: INSTHUHENTATfeN 



2, To nessure the effectiveness 
of the Success Vmm in 
improving language per- 
fdi-mahce of the stiidehts 
participating in the program 



|-referehced language test 
scores of Success . third graders 
Hill be cODipared to scores of a 
cbparisbn group ofjtudents. 
Statistical analysis of sample 
data on usage, mechanics and 
spelling measures.Hiii be per- 
formed using the Analysis of 
Variance procedure (/INpyA). 
Similar analysis. will be con- 
ducted on Composite language 
3cpre3,_ Success and comparison 
students, categorized into high, 
average and low achievement 
levels HiU.be compared. on norm- 
referenced language achievement 
.t63tperfprmance_injhe. component 
areas of ufiage, mechanics, and 
spelling, as well as their 
ccmppsite (total language. scores). 
The ANOVA procedure will be used 
to.oljseri'e forjaln effects.of.the 
Succeds program and interactions 
between treatment and achieverieht 
level. .Criterion rl' significance 
is set at 0.05. 



0 Norm-referenced 
iangoage achievement 
measure^ to be 
announced. 

0 IJiagnostic anii.fre- . 
scriptive Instrument 

used. in achievement 
level categorization. 



Begalar third grade 
Sttooess classes in 
Chapter. I. schools, 
identified as high 
impleinentersjHi) 
of the Snccess pro- 
gram ahd regular 
third grade classes 
from non-Suct: ' j: 
Chapter I sf.'vj,., 
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EJAtO/lTION 0B3ECTIVE . - 



HETHDD DF ANALYSIS 



INSTRUNENTATiON 



3. To. iiieaaure the effcctlvensss 
of Success program In Improv- 
Ing.Hritlng. performance. of the 
students participating in that 
j)rograir,. 



1. To measare the effectiveness 
Of the Sii e^j program in 
improving the reading 
attitudes of students 
participating in the 
program, 



S creative writing exercise vill 
be administpred twice (Jan. and 
April) to Suiicess and comparison 
c:a3se3. Jriting. "exercises will 
be rated on a.l-point scale 
two raters, utillzlhg the 
ho'istic scoring. method, Each 
rater .iiil rate each paper, 
resolving discrepancieajo. ... 
increase reliability. Statisti- 
cal analysis will be cbhducted 
on pretest-posttest gains using 
the analysis. of Variance pro- 
cedure (ANDVS)of significance 
set at 0.05. 

S.^eading attitude Inventory will 
be administered to Sycc ess and 
coniparison students, Data will be 
subjected to the Analysis of 
Variance procedure with the 
criterion of significance set at 



0 Writing samples of 
students in Succ^sa 
and comparison groups, 



Beading attltudinal 
inventory to be 

announce^. 

(Possibly Estes). 



Eegolar third grade 
Stteew classes; in 
Chapter. i. schools 
identified as High 
impiementers (HI) of 
Success program and 
the regular third 
grade classes from 
non-Success Chapter 
I Schools. 



Regular third grade 
Succ e ss classes; in 
Chapter. I. schools 
identified as high 
impiementers (HI) of 
the Success program 
P^l .t'egulair third grade 
classes from non- 
Success Chapter I 
^ools. 



EWLUKTION OBJEOm- 



5. To deteriiiihe the impact of the 
Success prograni on the "proiiibtibh/ 
.'^^^^"I'^lonj^teG of.thofie students 
participating in that prsgraiii. 



L to measure the effectivenesB of 
the Success program in improving 
the_readinq achievement of those 
BtadentB participating in that 
program at jeast three con- 
secutive years from second to 
fourth grade. 



^ ANALYSIS 



Descriptive statistics (fre- 
gpfificies arid percehtagesj of 
tbe profiiotion/retfentioh rates 
of Sueeessjecond,. third. and 
fourth graders »ili be coapared 
to Bysteiwide data at those gr" 
levels, sinllar statiaticB on 
Success fitudentfl assigned to 
transitibh classes for reading 
deficiencies will be compared to 
Bystemwide dati. 



ahalpis bh reading achieve- 
nent scores will be perforined on 

a three yea^ 
comparing continuing Soccess 
BtQdentB with a cbiiiparlsbh group 
of non-Success students. Analysis 
of Variance between Success and 
comparison group hbrm-referenced 
test score means will be perforjilied 
by year of exposure to the Success 
program. The criterion of 
significance is set at level. 



IMEOMMJIWflli- 
*nr utinun In 1 1 vn 



Obcunientation of promotion/ 
retention data will be pro= 
vided by the Evaluation 
System Section of the 
Division of Quality 
Assurance. 



Norm-referenced reading 
achievement test, to be 
announced. 



POPdLATION/SAtigLE 





thirdf fourth grade. 
SDccess fltiidehts and 
the entire student pop 
lation at these grade 
levels. 



fourth grade 
Success students 
identified as having 
consecutively par- 
ticipated in the pro- 
gram at the second, 
third and fourth grade 
leyelsi and non- 
Success comparison 
fourth grade students 
having never partlci- 
f^^^^M the Success 

nronrADi 



EV ALUiiTION OBJECTiyE — - MTHB5-9F-mgIS- - HIPLEHWiiTIOti - P9f4H.fflTOHR£— 











7 Tb iiieasUre the effectiveness 


Trend ahalvsls oil laiiBiiace 


Noriti-refereneed 


Reffular fourth cratfe 


nf the fSnr^p^^ nrnffram In 


;)chipvpntpnt- ^oorea will be 


lanfiuaee achievement 

AHIIKUUKV Uw|IAWiWlllb||w 


Sijc-cps^ students 






test tn hp annnnncpd" 


irtentiffpH haofni? 
iUvUii i 4>cu do - iidv iiig 


aphievpniehk fif thn^e ^t'iideht'fj 


referehhed abhlei/eftieht data 

1 vivl vllwvU a V 111 C * bill W II w uuwu 




bartlciiiatpd in the 

uui w^Vf^uaMcu 'ill uuvi 


narHrin,iHnff in fhat nroflrani 
|JQ| ill tiidi pi uq* 


;)prn<i^ ;) fhrpp vp^r snan: 




Siinpp*^*^ nrnffram rnn- 

yUkiV«i;pg yi U5I aiii. ^Ull 


dl icd«}l liircc LUiljcUUlIVc 


UUIIIJ^dl- UUIIlXIIUXIIg 




dCUUtlVwii/ dl lilc 


upars frnm ^ppnnH tn fniirfh 


<^iifmAoe qhiHpnH to a cciin^ 

UUC<^VwJ UwUUCUvU U w will 




serondi third and 








rnnrl*)! trrsHo 
lUUriil giaUc.lcvclj 








2)nd si hhrhhiiiri Qhh 
dilU d Lumbal Jig UN 




Variance (MU) will be 




ffrouo of fourth 




n^pH f'pqt ritffprpnnp<i in 




1^1 dUv wLUUCIILj 




larifliiaie nerforlhahces of 

^UIIKt^Hg^ M^l iVIIIIUIIv«<^ Wt 




hai/lnt? never 




fiMpppss anH pnmnari son 




nartln inal'pd in fhe 




afhlVuA Hv vp/ir hf pyhnqiirp 








I'n fhp ^M/^ndcm nrn^Pdm Tho 
lu iiiw JUCUCkJd p( u^r dill f 1 (ic 








criterion of significance is 








set at the 0,05 level. 




• 










EVALUATION OBJECTIVE 



witii the Success program. 



9« To determine teacher . 
8atis[actjoh with the Success 
program. 



10. To determine principal 
satisfaction with the Success 
program. 



mm mmu 



Descriptive statistics (fre- 
quencies arid percentagesh 
relative to questionnaire 
responses wili be analyzrf 
Recommendations. and comments . 
of students will be categorized 
and listed. 

Descriptive statistics Ifre- 
quehcies and percentages) « relative 
to questionnaire responses will be 
analyzed* Recommendations and 
comments of teachers wlll be 
categorized and listed* 

Descriptive statistics (fre- 
quencies arid percentages) , 
relative to questionnaire 
responses will be analyzed. 
Recommendat jons and. comments 
of principals will be 
categorized and listed. 



IHPLEHENTATIOW 



Student questionnaire. 



Teacher questionnaire. 



Principal questionnaire. 



PQPULATlON/SAHPtE 



AH students 
3-6) participating 
in the Success program. 



All Success teachers 
(Pre-kindergarten to 
6). 



All Success principals. 



I 

I 
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APPENDIX C 

ACTIVITIES roORDINAtm/GGNDUGTED 
BY SUeeESS DIRECTOR FOR 
SGHOOt YEAR 1935- 86 



Activities Coordinated/Conducted by Success Director for School 
Year 1985-85* 



1. Planned and conducted three-day summer training sessions for 
teachers interested in implementing the Success in R-eadiag 
and Writing Prbgrarrii 

Si Meeting with staff at tor ton Co rrec t ion Department - for 
evaluation of the Succ-e^ program at the Institution. 

3i Observation of and meeting with pre-kindergarten teachers 
at Rudolph Elementary School. 

4. Mini-workshop for teachers at Turner Elementary School. 

5. Orientation session with teachers at Draper Elementary 
School. 

6. Observation of Grade 6 class at Shepherd School - Use of 
Success lessons with computers. 

7. Meeting with Region D Success teachers at Nalie. 

8. Demonstratioh lesson at Lewis School with Grade 3 class.- 

9. Coordination of . demonstration/visitation of Mrs. Linda 
Daniels, Hoten School, for Grade 5 Success teachers. 

10. Meeting with teachers ((trades 3, 4, 5, 5) Hehdley School. 

11. Meeting with Region ft Success teachers at Savoy Educational 
Center. 

12. Mini-workshop for teachers at Simon Elementary School. 

13. Gohferencewith teacher at Ludlow-Taylor Elemertary School 
to plan for a mini-demonstration for the staff. 

14. Meeting with members of the staff of the Division of Quality 
Assurance to discuss the evaluation of the Success program 
for 1985^86. 

15. Coordination of demon s t r a t ion/ v i 3 ita t ion . 1 esson _ of Mrs. Alfrieda 
Pushia, M.L. King^ Jr.^ Elementary School, for Grade 4 Sciccass 
teachers . 

16. Observatipn of teachers a t .Gage-Eckington Elernentary School 
with Dr.. Helen Cappleman, Success Co~au onor/3onsui tant and 
Mrs. Lillie Liu, The Washington Post. 
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A ctivj^e3u:oord4 nate 4 (con't) 

17i eoordination of Success Administrators' Meeting. 

18. Development of Materials For Instruction Handbook for 
Grades 3, 4 and 5. 

19. Conducted workshops for Chapter i Parents on using the 
newspaper at home. Approximately 80 parents - Plummer 
and Gibbs Elementary Schools. 

20. Presentation on Success program at the Teachers' Convention. 

21e Facilitator _in The Washi ng-ton booth at tne Virginia Stat 
Reading Conference. 

22. Coordinated mid-year and end of the year meetings of Success 
administrators and teachers. 

23. Observed forty-seven teachers during the year. 

24. Developed^and disseminated three newsletters (Succ^ 
Highlight ) = — 

25. Individual conferences and meetings were held with Su^^^^ 
administrators and teachers on a request basis. • 

26. Information and brochures about the Success program were 
given to persons interested in finding out about the program. 
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APPENDIX D 
Estes Reading Attitude Scale 



ERIC 



Directions: Indicate yoar feelings about reading by Writing the letters 
A, B, C, or E in the blanR to the left of each statenent. 



A * strongly agree /B agree /C « undecided 
D * disagree /E strongly disagree 

PART I 

1. Reading is for learning but not for enjoyment, 

2. Honey spent on books is well-spent, 

3i There is nothing to be gained frem reading books. 

4. Books are a bore. 

5. Reading is a good way to spend spare time. 

6. Sharing books in class is a waste of time. 

7. Reading turns me on. 

8. Reading is drily for grade grubbers. 

9. Books aren*t usually good enough to finish, 
id. Reading is rewarding to me. 

11. Reading becomes boring after about an hour. 

12. Host books are tod long and dull. 

13. Free reading doesn^t teach anything. 

14. There should be more time for free reading during the school day 

15. there are many books which I hope to read. 

16 i Books should not be read except for class requi raments. 

17. Reading is something I can do without. 



18. A certain amount of sumriBr vacation should be set aside for 
readi ng . 

19. Books make good presents. 

20. Readi ng i s dul 1 . 
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[ 398 ] Estea Attitude Scales: Mea3Mr<b-jai AtUtPdea-Toward School Subiects 



readability. In the Mathemat- 
ics Basic Concepa t«t Ulascrations are attiactivcly 
ihtcrspmcd with word prpblcrm. At the iowcr leveh 
the Hlustrarions are simple but appealing. The test 
■ booklets contain, in adoition to qucarioa and page 
narabcn, »dendfyirig_piaui>D$ of animals to help 
students to keep their places.- 
- l''.*^'"?^*'?^ ^A^ feRB Comprehensive Testing 
Program dm be recommended on the basis djf its 
^^F^^c utility to teachers and administrators as 
well as^ the relevance of its content, which^ is 
*PP"lP"*^^ IwyiLthe classroom and more informai 
beaming. The form and content of the test itcms^ 
^^ctions for administradon, and explanation of 
scoring arc clear and understandable^ making it 
valuable for a variety of educational situations. 

f 398 ) 

Eates Attitude Scales; Measures of Attitudes 
Toward School Su^ects. Grades 3-6, 6^ i a; 1 975- 
8j;_ EASj 3 levels; manual ('81^ 23 pages); 1983 price 

j^^^. ♦-^ 1 » »- . _ r _ 

eary 1 
sheets : 

mijiutes; ^ 

ben C Richards, and Doris R^ttger; PRO- ED.* 

«) EtEMprrARY FbRM^ 3-H5; iqgi; 3 jicorcs: 

'^*^^<="^*'ic%_readin^^ s^^ 1 form (4 pages); $13 
per elementary booklets. 

I) SECONDARV VORSi. Grades 6^1 3| iggj. j scores: 
'"*^<='"*!ii3>j*eadln^ studies; i 

f^-™_(3 pagcsJi separate answer sheets must be uicd; 
|i:3^_pcr 50 secondary forms; $13 per 50 secondary 
profile/answer sheets: 



so to a 



per 50 secondary 

Sec T3:845 (6 references) and 8:371 (5 references). 



- I . Summen, 



TEST REFERENCES 



Revurw oj Estes_Anitt4dc /Stahs: Measures of 
Attitudes T^'^^ ^ ^ r , ^ ^ . ^^ ^ ^ J 

MitLERy AssocidU Dean for Gr^u^te _ Siudigs 
and Associate Profpsor, Graduate School oj Kdu4:a* 
tioh and Human B^eh^meni\ Umversity of 
RoOicster, Rochester, NY; 

The Fst« Attitude Scales were developed to 
assess the tastes of elementary (grades 3 through 6) 
and secondary (grades 7 through la) students_for 
Che content and study of basic school subjects. Test 
"'^^^"'^l attractively designed for 

convenient, efficient administration 'and hancl-scor- 
mg by classroom tea^^^^^^ The manual Is brief, well 
organized, well written, and generally intellieiblc to 



«rsnbhdents to indicate on a five- 
point scale (sccondwy form)^or threc.p^^ scale 
M^f"^"^^ .f^^ their agrcement/dUagreemeni 
with statements that reflect a positive or negative 
bia3 toward a particular school subject. Though each 
scale includes both favorably and unfavorably 
\vorded statements, different scales do 
^^^Pl^f^ri^ph^^c extent. 

S^"'^'^^^" JP^f'^y'^ cn^phasized content 
relevance arid homogeneity of factor structure 
among itcmsj>€xtaining to the same subject matter. 
Item selection for the final yersion of the sccohdary 
^M* <^ accomplished In stages chat 
successively inyoiycd content analysis, item discrimi- 
P^atibn analysis, and Factor analysis with rotation to 
simple strQctUje (Vsin of the full 

inter-iterii correlation matiix. The elementary form 
^^A^!^ jnnio^ discriminating items of the 
secondary Mathematics, Reading, and Science 
scales. Vocabul^ adaptation of items to the clemcn- 

dated through several 
d group discussions 

. -__ _ ^ _ ^ grade children. As 

m the case of secondary scales^ the item-selection 
cnterion foi^thc final version of the elementary form 
was homogeneity of within.scalc fectbr structure. 
This stratcgyj)ix)duced for both forms scales^ that 
represent distinct subject matter emphases. Unfortu- 
"^l^Jy_> f^fior Jtructurca reported^ for the final 
version of the secondary form were not derived from 
freshly sampiled data. They resulted,^ instead, from 
analysis of partial data sets from which items with 
weak or ambiguous factor loadings had been elimi- 
nated. This was not the case for the elementaiy 
scales, which were administered in final form to an 
entjrclyjlcw sample prior to the final facte 



, _ _ . -onng. 

w...*!*.^ ivif^uiures Reported reliabilities of the internal consistency 

toward ^School 5f.$J^'*y ' /S/^'' K ^^^^^^"^ ^IpHa] are respectable for measures 

elementary scale. Coefficients for the secondary 
form were, like the final feccor analyses of item data, 
based on partial data sets. Failure to present 
evidence regarding test-retest reliabilities may be the 
most serious deficiency in the technical properties of 
the Estes Scales: The ^tabili£y of anv measure 
pujp'^rtedly relevant to educational practice, or any 
other continuous process variable, should be exam- 
ined carefully. It is important to establish that 
^^.^^'■^ °[ ^_^Li_kihd arc not the product of unstable 
traits or transitory states: 



the non-techriically oriented user. It is unpretentious 



J.--.- npretentious Construct validation of the elementarv and «:prnn 

.n^purpcsc and .n .ts recommendations 6r use and dan, forms attended to both conV^e^^nd di cr°^ 
mterpretation; directions for administration, seorine ^ ai^cnm- 



converger 

*"MLy^l^4i^y. of individiia] subject matter scales: 

no . • - - r Extrinsic measures of Mudents' interest in each 

-A construction, psychometric school subject were obtained from the resoondents 



and use of norms tables are clear and simple; and 
technical data - ' 
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cbiirse grades, standardized achievement test scores, 
5?^*^'^*^J^J"yA^v^^ in cc)ursc-rclatcd 
activitiw. Though on the _ whole cdffclatjohal evi- 
^^"^^ ^y*^^^_condit^^^ both convergent 

and discriminant validity of individual jntercst 
scaleiy findi ngs were somewhat mixed for che 
seqondaiy Form, in pmicular, the djscTimihant 
y^^J^i^' P? English inte was confounded by 
relatively high correlations between English critcri. 
?fl_nicasure5 and reading interests. This k hariiiy a 
surprising discovery^ considering the likelihood that 
reading interests arc relevant in a global sense to 
other aademic interests, 

_ Finely, it must be noted that "national" norms, : 
'^P°?~_^" J^n"» i^orrhalized T-scores and 
percentiles, depend on an inadequate data base for 
to scbbbl population at large. 
Distribution of the norms sample by sex, race, and 
°J!^^!_^^„^^|_rcsidencc^ V as proportlonaL to their 
representation in the :iatjc»naj populatjon. However, 
t|^^_5j^<: of the combined norms sample for both 
levels was only i,8 1 j students ^969 at the elementa- 
level arid 846 at the secojidaiy level), with 
geographic represcntaiidn limked to five states. 

In sunimary, the Elstes Attitude Scales appear to 
have been competently constructed. They evidence 
a conscientious attempt at compliance- with pfocc- 
daral standards^ for test development. The deficien- 
cies of these measures seem to be principally the 
^^^"^t_'°^,5_onj'P™_^^^^^ attributable to the 

authors' limited resources, Although the Estes Scales 
T^cqmm^^^ as a basis for comparisons 
with ^national trends, they could constitute a useful 
^/l^_*De^P_e_ns[ye means t ends: (a) 

simple description of children's sentiments regard- 
i^^lS of standard curriculum; (^) 

acquisition of affective <iata relevant to curriculum 
research arid evaluation^ especially at the Local lev^l; 
and (r) development of local rwrms f^^ 
asscssmerit of children's subject matter preferences; 
Any of these o^bjcctives mighty be Accomplished 
without undue reliance' on the instruments' weaker 
features, while capitalizing in particular on the 
pJ^yiPMS care and attention to detail that character- 
ized the development of the Estes Scales, 
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Holistic Scaring 



o 

ERIC 



HOtiSTie SeORiNG 



Holistic scoring (Spandel and Stiggin, 1980) is based on raters reviewing 

a paper for an overall or "whole" impression. Although specific factors 
(grammars vocabular^^ etc.) may. influerice the rater's response, these 
considerations are never di rectly addressed^ Gonsistency--both anong raters 
and amdngLScdres assigned by a single rater--is very ifnportant in holistic 
scoring (Spandel arid Stiggins, p. 2d). 

The papers will be rated on a four-point scale. Before the scoring 
process begins, "^V-t he trainer and the most qualified or experienced raters 
will review a subtest of the papers to be scored in order to identify range 
finders." (ibid) . Range finders are representative of all the papers at a 
given scoring level . Range finde|^ are received for each score^ respectively, 
that is^ for 4, 3^ 2* and 1. Paperj used as range finders at given levels 
stould be so typical of papers at that level that all raters agree to the 
assigned score. Range finders are used as models to assist raters during 
scoring. 

In holistic s coring t here is not any predetermined^^at^ijrL^r^^ 
iij€ntafjf-4 -ange-f4TTders . For example, "A saser a^^ignpH a cmro nf i u.i1l 
simpjy be a relatively high quality paper within a given group; it may or may 
not be an excellent paper in its own rights" ^- - ^ 



It has been found that the holistic approach will produce marked 
cdhsistericy among raters (reliability). 

Two rate should read all papers to minimize the chance of error 
resulting fran rater fatigue, pr^'udice, or other extraneous factors. 

In order to determine a final score, scores_may be added or averaged 

across raters. If there is di sagreenent of more than one rating point, it can 
be resolved through discussions by the disagreeing raters. 

Experienced raters can go through 30 to 40 papers per hour, to insure 
high reliability, scoring should be restricted to six hours per day. Best 
results are received with short hours and frequent breaks. 

Source: Spfndel , Vicki and St iggi ns^ Richard J. Rirpri- Measures of -Writing 

SfeiXT . Northwest Regional Educational baborato ry: t lean nghou se for 
Applied Performance Testing. Portland, Oregon. 
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PK-K Teacher Questionnaire 



111 

O 

ERIC 



ERIC 



District of _Coluinbia Public Schools 
Success In Reading and Writing Program 

Prekihdergarten and Kindergarten Teacher 
Que St ionna i r& 

Since you have been a participant in the Success in Reading 
and Writing Program your reactions are ah i.Tportant part of the 
assessment of the overall program. Please complete the following 
questionnaire items as indicated. 

(1) Please rate the level of enjoyment experienced by you and your 
students with the following modules by placing in X on the 
appropriate number. 

Pietxire Word Association Module 
Teac h e r 

Very Unenjoyable 12 3 4 5 6 7 Highly Enjoyable 
Student 

Very menjbyable 1 2 3 4 5 6 7 Highly Enjoyable 
Aipl^bet Module 

Teacher 

Very Unenjoyable 12 3 4 5 6 7 Highly Enjoyable 
atudent 

Very Unenjoyable 12 3 4 5 6 7 Highly Enjoyable 
Oral Language/Reading Module 
Teacher 

Ver^' Unenjoyable 1 2 3 4 5 6 7 Highly Enjoyable 

Student 

Very Unenjoyable 1 2 3 4 5 6 7 Highly Enjoyable 

Story Time Module 
Teacher 

Very Unenjoyable 12 3 4 5 6 7 Highly Enjoyable 

Student 

Very Unenjoyable 12 3 4 5 6 7 Highlv Enjoyable 
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I*, j-xease rata tha fextarit tha Socc^ Pre*-*- hai iS,^««*>* .u- 
kindaxgartan atudantsT "c-'i^iargarten and 



£it«ia ZB^risvaaeht 12 3 



4 5 6 7 



Great Improvement 



(3} Stodiati participating in the Su^^esa^-cc-am a« 
proud of their academic accompil^ffiT^^ 



Yas 



Mo 



«ii4 latii^lii, eoiieJta ll^M^'. * tan^lsxe items 



7as 



Mo 



Yes 



No 



{6) PisBsa indicate below if 

tha reason for the difficulty. ^^acn. state briefly 




(7) Did you usa the success method exclusiv.lv f 
kindergarten or kindergarten classes?" 



:or your pre- 



Yei 



If the answer is no, please, indicate b-'r-v -^w, 
ualng tha S^ss metSod exclasiv;!? ^'^'^ 




(8) Indicate the number of modal 

12 3 4 

(9) indicate the numb 



Progranii 



es you typically use per da 
er of days per week 



12345 
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you use the Succ 



es 



Do you plan to use the Success program again next year? 



Yes 



RO 



(iiJ Please list below advantages and disadvs.-ta 
Success program. 



ges of using the 



(12) In your opinion, which students benefit most from the 
Success Program approach; high ability, average ability, 
or low ability ? (Please circle one.) 

(13) Please express any recoitutiehdations you may have cohcerhin 
the Success Program. (How^ if at all, would you change it 



Thank you for your invaluable assistance. Best wishes for a plea' 
remainder of the schoolyear ! 



Revised, 1985 
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District of Cbluinbia Public Schools 
Success, In Reading and Writing Program 



Elementary Teacher Questionnaire 

Since. you have been a participant in the Success In 
Reading and Writing program your reactions are an. important _ 
part of the assessment of the overall program^ Please complete 
the following questionnaire items as indicated; 

Please checJc the box indicating what grade you teach* 

First / 7 Second / 7 Third 

Fourth / 7 Fifth Sixth /~7 

1. Please indicate by placing an X on the appropriate 
number the degree you feel the Success program has 
improved the reading performemce of your students. 

tittle 33SprcDvemeht 1 2 3 4 5 6 7 Great Improvement 

2. Please indicate below, if applicable, _ the modules you 
have found most difficult to teach. State^ briefly, 
the reason for the difficulty. 



3. Do you use the Success program five days per week? 
Please check the appropriate box. 



Yes rZJ 

4. If the answer to Number 3 is no^ please^ indicate in 
the blank below how many days per week you used the 
Success program. 



5. If yoa did not use the Success program 5 days per week 
please state below why you didn ' t . 



EKLC 



Are ail Success moduies taught by yon when you use 
the Success program? Please check the appropriate 
box« 



Yes / 7 No / 7 

If the answer to Number 6 is no, please state below 
which modules you usually teach * 



Please also state on the blanks below/ if applicable, 
why you teach only the moduies you indicated in Number 7. 



Have you had any problems. incorporating the Success 
program with the Student Progress Plan objectives? 

Yes / 7 No /~7 

If the answer above is yes^ please, indicate why 
incorporating Student Progress Plan objectives with 
the Success program is a problem. 



Please indicate in the blank below the number of the last 
Success lesson taught by you. 
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il. Did you use the Success program exclusively in your 
readiilg/ianguage arts program? 

Yes / 7 

12* Please list advantages and disadvantages of the Succe_sa 
prdgram.; (Use back of the sheet if necessary.) 

Advantages : 



Disadvantages : 



13. Are you planning to use the Success ^Ln^eading ana._KiiitirLg 
program next year? 



Yej /^T No / / 

14* In your opinion* which students benefit most from the 
Succes s program approach; 

(Circle One) high average low ability? 

15. Please express any recommendations you nay have cbhcerning 
the Success program. (How, if at all, would you change it?) 



THANK YOU FOR YOUR INVALUABI^ ASSIS'*'A>iG£ . BEST WISHES TCP. 
A PLEASANT REMAINDER OF THE SCHOOL YEAR* 
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District of C6ian£ia Public Schools 
1984-85 SUCCESS IN .READING ^ND vJRiTING PROGRAM! 
STUDENT QUESTIONNAIRE 

MM SCHOOL 

GRADE 



YES NO 

1. Do you enjoy participating in this ^Succes3 in ( ) ( ) 
Reading and Writing'' program at your school? 

2. Would you liXe to have the progran continued ( j ( ) 
at your school? 

3. Has the.prog'ram helped you in your other class ( ) ( ) 
studies? 

4. Are you more confident in yourself in reading ( ) ( j 
since you've been in the program? 

5. So you read JbooJcs^ magazines^ or the newspaper) ( ) ( ) 
xnorQ now in your spare tine? 

6. Do you enjoy working in class with a partner? ( ) ( ) 

7. Has the program enabled you to express yourself ( ) ( ) 
bettex in writing? 

8* Do you have enough time for writing during the ( ) ( ) 
instructional period? 

9. Do you like having individual help given to you ( ) ( ) 
by your teacher? 

10. What do you like most about the program? ' 



11. What do you like least about the program? 



12. Would you change the program? How? (please use back of page 
if necesseuryi) 



THANK YOU FOR YOUR INVALUABLE ASSISTMICE. BEST WISHES FOR A 
PLEASANT HEMAINDEP OF THE SCHOOL YEAR! 



Revi 
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Principal Questionnaire 
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District of Columbia Public Schools 
Success In Readia^^nd^Jtrlting Program 

P^xncipal - Que s t io nna i re-S 

The purpose of this questionnaire is to find out your 
reaction to the Success In Reading and Writing program. 

1. Do you feel that children in_ the Success program have 
shown more improvement, at this point:, in reading and 
writing abilities than children in other reading 
programs being taught at your elementary school? 

Less Improvement 1 2 3 4 5 6 7 Greater Improvement 

2. In general^, do you feel the Success program has helped 
to improve teaching abilities of participating teachers 
within your school? 

Less improvemeSt 1 2 3 4 5 6 7 Greater Improvement 

3. Are the teachers of your school using other reading 
programs along with the Success program? 



Yes / 7 No / / 

If the answer is yes^ please indicate below the 
reading programs being utilized. 



Please indicate below alsd^ the reason(s) why it was 
felt other reading programs were needed . 



4. Have your teachers encountered any problems utilizing 

the Success In Reading and Writing program in conjunction 
with the Student Progress Plan? 

Yes / 7 No / 7 
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5. Are tRe_ obj ectlyes » basic assumptions and objectives 
and .rationales being adhered to, as closely as possible 
by your teachers? ^ 7 => pubsioxe. 

Yes No 7 — 7 

^* yon are not familiar enough with the Success program 

in i?finl?n.^'%^'^'^'''^°e'.^°"^^ >'°" be-Tftlfes'tef 
m attending a Success workshop for principals? 

Yes £~7 No / — 7 

ttVu? j?Hlllf"^ ^" ^i^SCm program continuing 



Yes / 7 No / 



t"e"sSlMli1r?Ili?' disadvantages yo. see ,nth 

Advantages : , 



Disadvantages : 



Revised, ; 
March 1984 
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APPENDIX J 
Gbservatioh Ghecklist 
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tfiE SUCCESS I N jU-AELUlS-^N'EL Jm IX IKG-mBBMM 



LBJEL OF IMPlE^t&mtrdN" CHHCKLIST 



Sdiool 



Date_ 



Teacfier 



Grade 



En ro linen t 



Lesson Ko. 



Number Present 



Tirr.e of Observation 



^^od^le Observed 



C } Pieture/^Vbrd Association 



i 3 
i ) 
( ) 



C ) 

C ) Oral Language 
( } Story Time 

Phonics/Spelling 
Language Experience 
teadeniic^ Cultural Arts 
and Current Events Reading 
( ) Patterning 



C ) Decoding in Context 
( } Coroosi tion Fiuenc) 
I } Composition 

Research Practicum 
Study Skills 
C 3 Current Events 
C ) Writing 

C ) Recreational Reading 



C 3 



1. 
2. 
3. 

4. 



Schedtiie posted 
l\fhble class instruction 



Individualized instruction 
(contact with each child) 

Charts (15 or more) 

(a) accessible and reading 

(b) oE words 

(c) cE tcord clusters 

(d) of sentences 



^y^ler°nts 

Yes 
( ) 

C } 

C ) 



Use of printed ixtterials 

(a) newspapers 

(b) magazines 

(c) librar)' books 

(d) dictionaries 

(e) textbooks (science ( ) , 
nath ( ) , social 
studies ( ), music C ) ) 

(f) maps 

(g) encyclopedia 

(h) telephone books 

(i) catalogues 
(j) charts 

(k) comic books 

(1) othe r 

specif)' 



( } 
C 3 
( } 

( 

c ) 

( ) 

c ) 

( ) 
( } 

c ) 
c ) 



( 3 

c 3 
( 3 
C 3 
( 3 
C 3 
( 3 



No 

( 3 
( 3 
( 3 

( 3 
( 3 
( 3 
( 3 
( 3 

( 3 
( 3 
( 3 
( 3 
C 3 
C 3 



C 3 
C 3 
( 3 
( 3 
( 3 
( 3 
( 3 



Yes 



Ho 



6. W ting Activities 
tfi) wortls 

(b) factua^infertutibii 

Cc} C»3tiY» 

(a) otfie^ 



7. 
8^ 



specify 
goao ajil CTtihg with partners 
Cbhfetence with teacher 



( ) 
C ) 
£ ) 
C ) 

C ) 
C ) 



C ) 

i ) 
( } 

C ) 
£ ) 



Student BehaviiSri 



Participation in Pre^cLxscxissidn 

Suggesting vocabulaiy 

OEhe t^ • 

• specify 

Participation in Folloi?*i^ 
Activity 

for letters 
vortis 
pictures 
other 



"ipSEHy 



Writing 



Filing of papers 

Evidence of Student ^thtistasm 
Additicnol Cdnients 



APPENDIX K 

Background : fhefcevel of Use 

IiTterview-iticf Technique 
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Th« L«v«i of Usm Interview 

i„S.J?L^"l*^"L''^°"" " measure the individual's Loa is the focused 

.According to Merf.oh, Fiske and Kendall^, ths '•focused interview" 
e|nplpya an interview guids with a list oS objectives and qUeIt"ns SuHiJ^s 

^"f J-"*' '^^'^^L^'^^r ^-^^ori^ oi the inte^ii^w °Sid^ !n 

th« LOU interview, a nunber of specif ic- questions are required Ilnce they 

f^;;^??'" efficient in eliciting the necessary in- 

forMtion.^ Hpwevar, thr interviewer IS intiaiateiy knowledgeable of the ob- 
jectives of the interview and IS often required to use judgment in sequencing 
Of these questions, as well as in following up insufficient responses with 
further questions and probes. 

±nt.JiL*r^*^^^K" °^ * "^^'"^ * ^^ighiy structured 

»« tai^ (one that requir^ standardized questions, probes and procedures) 

*.f Although the LOU interview does require 

I'TS^ ^'"^T' ^* to that probes and 

lli t^ ^"tions can be con^letely standardized andltiU be appropriate 
5ia«rri?«^ J''^ «accoby4 note, less structure! inter- 

views allow for standardization of meaning rather than relying on the same 
worda to mean the same thing to each interviewee. Each individual who is 
interviewed responds differently in extent, as well as content, and for the ■ 
objectives of the interview to be met, foiiow-up to responses must be indi- 
vidualized. Meaningless and misleading questions can be avoided by allowing 
the interviewer this flexibility. Eess rigidity also encourages more true- 
to-ltfe responses since the respondent can follow a natural train of thought. 
Thus, mor| complete and detailed^ responses are obtained, and the interviewee 
feels comfortable as If ma normal conversation, it is obvious that a con- 
sequence of the focused interview is the necessity for more vtgorocs inter- 
viewer training. However, the amount of freely provided and inoortant ir- 
formation that has been obtained through over 1,630 lSu in-o-v-^ws s-'-oor-s 
the belief t-Jiat the selection of this interview procedure was we'' -ade 



R. K. Mertbn. M. Fiske and P. K. Kendall, rhi Foc-jsed rr.'^^--'^w A 
lafiual of Problems and Procedures (Glencoe, ILl.: Free ?res s ,' "ti^s 
4 

E. E, Maccoby and N. Maccoby, "The Interview: ft Too i o^ Scc-a^ 
Science, in Handbook of Social Psychology. Vol. 1, ed. by 3. ii-.d=ev 
[Cambridge: Addison-Wesiey , 1954). -- — - . 
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I 9 ~R BilST G9PY AVAILABLE 



It should be noted here that a recognized aiterhative 
to ihterviewihg is observation, In research, it is naturally 
the goal to be as rigorous as possible. It follows that , if 
one desires, to measure behavior, it should be through obser- 
vation of that behavior rather than through reliance on the 

subject to report how she/he behaves or behaved. However, 

the interview has advantages over . observation , and these adyan- 
ta/jes apply to the case of measuring LoU. Dean, Eichhorn and 
13ean note that: 

(1) Interviews can get at past events, at events when 
the interviewee is alone, and at situations where 
outsiders would alter behavior; 



(2) Interviews can reveal behavior not occurring 
during times when observations are made; 

(3) Interviews can reveal relationships that cannot 
be observed ; 



(4) Interviews are quick and efficient. 

in the case of measuring LoU, all of the important user 
behaviors could not be observed without shadowing the user for 
long periods of time and delving into correspondence , 
conversations , planning sessions^ contemplation, all of which 
might changeif ah outs ide observer were. to be present. An 
interview was selected as the most feasible means for 
collecting LoU data^on large samples* Furthermore ^ it is_ the 
most efficient way that has been found to determine the LoU of 
innovation users within a single school or university. 

the problem remains that relying chief ly oh the self- 
report of an individual may not give a full, true picture 
of that individual's behavior. To compensate for this 
potential weakness, the Level of Use interview has been 
developed in such detail that quest ions can be asked about 
various independent yet related behaviors thatcontributeto 
establishing an individual's overall Level of Use. Maccoby and 
Maccoby point _oUt that if a number of questions are 
asked that differ in form and .content but are related in a pre- 
dicted meaningful or logical fashion (as they are through 

operational definitions of Levels of Use), then a high corre- 
lation between responses to these questions indicates that they 
tap a common characteristic of the individual, Ithas been 
found in Levels of Use research that an individual '^s responses 
to the interview questions are highly correlated^ and therefore , 
it can be assumed with a high degree of certainty that they measure 
what they purport to measure. Level of Use of the Innovation. 



^ J.B. Dean, R.L. Eichhorn and L^R^ Dean, ''Observation and. 
Interviewing," in An Introduction to Social Research, ed. by 
J.T. Doby (N.y.: Appleton-Century Crofts, 1967). 

^ Maccoby and Maccoby, 1954. 
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Generic Nature of the Interview 

Another important characteristic of the LoU interviiaw is 
that it i3not_ specific to any one innovation ; that is^ it is 
generic. The LdU concept and the recommended interviewing 
procedure can be used for any innovation i Different questions 
are not required for. different innovations. This wiii become 
apparent as more is learned about the interview. 

Levels of Use of the Innovation 



. . Before reviewing the_in terview and rating procedures in 
detail^ it is of utmost importance that potential users of this 
system internalize the Levels of Use concept. For this reason, 
an article explaining Levels of Use is reproduced here'. Note 
that both raters and interviewers need to memorize the Levels 
of Use ehart by the end of training. Familiarization with the 
levels and categories is a prerequisite to beginning training 
in both rating and interviewing skills. 



*Note; The Success Program evaluator successfully completed a 

Levels of Use training program conducted by the Division 
of Staff Development (DCPS) in September, 1986. 



7 - 

G.E. Hall, S.F« Loucks, W.L. Rutherford and B.W. Newlove, 
Levels of Use of the Innovation: A Framework for Analyzing 
nnovation Adoption," Journal of Teacher Education, 26 (Spring, 
975). 
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